Jun 11 12:21:11.440827 ip-10-0-132-239 systemd[1]: Starting Kubernetes Kubelet... Jun 11 12:21:11.805591 ip-10-0-132-239 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:21:11.805591 ip-10-0-132-239 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 12:21:11.805591 ip-10-0-132-239 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:21:11.805591 ip-10-0-132-239 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 12:21:11.805591 ip-10-0-132-239 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:21:11.806256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.805645 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 12:21:11.808939 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808923 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:21:11.808939 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808938 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808942 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808945 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808948 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808951 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808954 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808956 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808959 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808961 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808963 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808966 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808968 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808971 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808978 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808980 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808983 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808985 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808987 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808990 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808992 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:21:11.809000 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808994 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808996 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.808999 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809001 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809004 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809006 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809009 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809012 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809014 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809016 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809019 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809021 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809024 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809026 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809028 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809031 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809033 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809035 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809038 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809040 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:21:11.809435 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809042 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809045 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809047 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809049 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809052 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809055 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809057 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809059 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809061 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809064 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809066 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809069 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809071 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809073 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809076 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809079 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809081 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809084 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809086 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809088 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:21:11.809897 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809090 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809093 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809095 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809097 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809100 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809102 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809104 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809106 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809109 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809111 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809113 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809116 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809119 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809122 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809125 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809128 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809130 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809133 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:21:11.810374 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809136 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809140 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809143 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809145 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809147 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809149 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809151 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809154 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809158 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809161 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809164 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809167 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809169 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809172 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809174 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809176 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809178 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809181 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809183 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:21:11.810794 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.809185 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811237 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811244 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811247 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811251 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811255 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811260 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811263 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811265 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811268 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811271 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811274 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811276 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811279 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811281 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811284 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811286 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811289 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811292 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:21:11.811296 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811295 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811299 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811302 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811305 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811308 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811311 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811313 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811316 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811319 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811329 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811332 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811335 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811337 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811340 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811342 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811344 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811347 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811349 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811351 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:21:11.811755 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811354 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811357 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811360 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811362 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811364 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811367 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811369 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811371 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811373 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811376 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811378 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811380 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811382 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811384 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811387 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811390 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811392 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811395 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811397 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811399 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:21:11.812180 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811402 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811404 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811406 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811409 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811411 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811413 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811415 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811418 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811420 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811422 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811424 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811427 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811429 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811431 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811434 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811436 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811439 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811441 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811443 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811446 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:21:11.812684 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811449 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811452 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811454 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811457 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811459 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811461 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811464 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811467 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811469 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811478 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811481 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811483 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811485 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811488 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811490 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811492 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811495 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811497 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811500 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811502 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:21:11.813139 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811505 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811507 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811869 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811874 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811877 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811879 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811882 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811885 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811887 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811890 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811892 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811895 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811898 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811900 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811904 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811907 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811910 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811912 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811915 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:21:11.813613 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811917 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811920 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811922 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811924 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811927 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811929 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811932 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811934 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811936 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811939 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811941 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811943 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811946 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811948 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811951 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811955 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811958 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811961 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811963 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811966 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:21:11.814048 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811969 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811971 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811974 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811976 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811979 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811981 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811983 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811986 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811988 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811990 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811993 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811995 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.811997 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812000 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812002 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812004 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812006 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812009 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812011 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812013 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:21:11.814490 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812016 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812018 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812020 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812023 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812026 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812028 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812030 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812033 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812035 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812037 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812040 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812042 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812044 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812047 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812049 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812052 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812055 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812057 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812059 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812061 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:21:11.814977 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812064 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812066 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812068 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812071 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812073 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812075 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812077 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812080 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812082 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812084 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812087 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812089 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812092 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812095 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812099 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812102 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812108 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812110 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812113 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:21:11.815429 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812115 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812117 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812120 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812181 2569 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812188 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812193 2569 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812197 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812202 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812206 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812211 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812217 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812222 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812226 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812230 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812235 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812238 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812240 2569 flags.go:64] FLAG: --cgroup-root="" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812243 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812246 2569 flags.go:64] FLAG: --client-ca-file="" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812248 2569 flags.go:64] FLAG: --cloud-provider="external" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812251 2569 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812256 2569 flags.go:64] FLAG: --cluster-domain="" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812259 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 12:21:11.815899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812262 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812265 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812268 2569 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812272 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812275 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812278 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812282 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812285 2569 flags.go:64] FLAG: --contention-profiling="false" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812287 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812290 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812293 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812296 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812299 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812302 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812305 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812307 2569 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812310 2569 flags.go:64] FLAG: --enable-server="true" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812313 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812317 2569 flags.go:64] FLAG: --event-burst="100" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812320 2569 flags.go:64] FLAG: --event-qps="50" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812323 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812326 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812328 2569 flags.go:64] FLAG: --eviction-hard="" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812332 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 12:21:11.816408 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812334 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812337 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812339 2569 flags.go:64] FLAG: --eviction-soft="" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812342 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812344 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812347 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812349 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812352 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812355 2569 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812358 2569 flags.go:64] FLAG: --feature-gates="" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812361 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812364 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812367 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812369 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812372 2569 flags.go:64] FLAG: --healthz-port="10248" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812375 2569 flags.go:64] FLAG: --help="false" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812377 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-132-239.ec2.internal" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812380 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812383 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812385 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812388 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812391 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812394 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 12:21:11.816951 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812396 2569 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812399 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812401 2569 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812405 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812408 2569 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812411 2569 flags.go:64] FLAG: --kube-reserved="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812413 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812416 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812418 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812421 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812423 2569 flags.go:64] FLAG: --lock-file="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812426 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812429 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812431 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812436 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812438 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812441 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812443 2569 flags.go:64] FLAG: --logging-format="text" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812446 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812449 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812451 2569 flags.go:64] FLAG: --manifest-url="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812454 2569 flags.go:64] FLAG: --manifest-url-header="" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812458 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812461 2569 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812464 2569 flags.go:64] FLAG: --max-pods="110" Jun 11 12:21:11.817485 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812467 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812470 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812478 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812481 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812484 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812487 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812489 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812496 2569 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812499 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812501 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812504 2569 flags.go:64] FLAG: --pod-cidr="" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812507 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812513 2569 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812516 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812518 2569 flags.go:64] FLAG: --pods-per-core="0" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812521 2569 flags.go:64] FLAG: --port="10250" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812524 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812526 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f49270e12fec0ea" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812529 2569 flags.go:64] FLAG: --qos-reserved="" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812532 2569 flags.go:64] FLAG: --read-only-port="10255" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812549 2569 flags.go:64] FLAG: --register-node="true" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812552 2569 flags.go:64] FLAG: --register-with-taints="" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812556 2569 flags.go:64] FLAG: --registry-burst="10" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812559 2569 flags.go:64] FLAG: --registry-qps="5" Jun 11 12:21:11.818072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812562 2569 flags.go:64] FLAG: --reserved-cpus="" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812565 2569 flags.go:64] FLAG: --reserved-memory="" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812568 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812571 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812574 2569 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812576 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812579 2569 flags.go:64] FLAG: --runonce="false" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812581 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812584 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812587 2569 flags.go:64] FLAG: --seccomp-default="false" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812589 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812592 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812595 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812597 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812600 2569 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812603 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812605 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812608 2569 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812610 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812613 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812617 2569 flags.go:64] FLAG: --system-cgroups="" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812619 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812624 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812626 2569 flags.go:64] FLAG: --tls-cert-file="" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812629 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 12:21:11.818638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812633 2569 flags.go:64] FLAG: --tls-min-version="" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812636 2569 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812638 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812641 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812643 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812647 2569 flags.go:64] FLAG: --v="2" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812651 2569 flags.go:64] FLAG: --version="false" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812661 2569 flags.go:64] FLAG: --vmodule="" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812667 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.812670 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812777 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812780 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812783 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812785 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812789 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812792 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812794 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812796 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812799 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812802 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812804 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812807 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:21:11.819192 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812809 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812811 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812814 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812816 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812818 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812821 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812823 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812826 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812828 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812830 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812833 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812835 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812837 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812839 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812842 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812844 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812846 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812849 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812853 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812855 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:21:11.819727 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812857 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812859 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812862 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812864 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812869 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812873 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812875 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812878 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812881 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812883 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812885 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812888 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812890 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812892 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812895 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812898 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812901 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812904 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:21:11.820183 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812908 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812912 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812914 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812917 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812919 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812922 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812924 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812926 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812928 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812931 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812933 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812935 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812939 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812942 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812944 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812946 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812949 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812951 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812954 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:21:11.820615 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812957 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812959 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812961 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812964 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812967 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812969 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812971 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812974 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812976 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812978 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812981 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812983 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812985 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812988 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812990 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812993 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812995 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.812997 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813000 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813002 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:21:11.821038 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813004 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813007 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813009 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813011 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813013 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813017 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813019 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813022 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813024 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.813026 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.813032 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.819386 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.819400 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.819419 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.819428 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 12:21:11.821723 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819485 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819489 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819493 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819497 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819500 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819503 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819506 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819508 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819511 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819514 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819516 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819519 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819521 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819524 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819527 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819529 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819531 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819549 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819553 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:21:11.822315 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819557 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819559 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819562 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819565 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819568 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819570 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819573 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819575 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819577 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819580 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819583 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819586 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819588 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819590 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819593 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819595 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819597 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819600 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819602 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819604 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:21:11.822801 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819607 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819609 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819611 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819614 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819616 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819618 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819621 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819623 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819625 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819628 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819630 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819633 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819635 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819637 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819640 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819643 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819645 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819647 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819650 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819652 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:21:11.823241 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819655 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819657 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819659 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819662 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819664 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819666 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819668 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819671 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819673 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819675 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819677 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819680 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819682 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819684 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819686 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819688 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819690 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819693 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819695 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819697 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:21:11.823708 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819700 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819703 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819707 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819709 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819712 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819714 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819716 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819718 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819721 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819723 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819727 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819730 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819732 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819735 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819738 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819740 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819743 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819745 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819747 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:21:11.824157 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819750 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.819755 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819858 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819863 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819865 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819868 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819871 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819874 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819878 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819881 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819883 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819887 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819889 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819892 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:21:11.824607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819894 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819897 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819899 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819902 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819904 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819907 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819909 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819911 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819913 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819915 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819918 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819920 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819922 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819925 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819927 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819929 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819932 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819934 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819937 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819939 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:21:11.824926 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819941 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819944 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819946 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819948 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819951 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819953 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819959 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819961 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819963 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819967 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819969 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819971 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819974 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819976 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819978 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819981 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819983 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819986 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819989 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:21:11.825366 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819992 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819995 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819997 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.819999 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820002 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820005 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820007 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820010 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820012 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820014 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820017 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820019 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820022 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820024 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820026 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820028 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820030 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820033 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820035 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820039 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:21:11.825817 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820041 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820044 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820048 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820050 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820053 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820055 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820057 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820060 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820062 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820064 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820067 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820069 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820071 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820073 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820076 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820078 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820080 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820083 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820085 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:21:11.826257 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820087 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820089 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820092 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820094 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820097 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820099 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820101 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820104 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:11.820106 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.820111 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.820246 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.823265 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.824563 2569 server.go:1019] "Starting client certificate rotation" Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.824654 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:21:11.826694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.824683 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:21:11.827059 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.826955 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:21:11.830094 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.830075 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:21:11.837104 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.837085 2569 log.go:25] "Validated CRI v1 runtime API" Jun 11 12:21:11.839335 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.839321 2569 log.go:25] "Validated CRI v1 image API" Jun 11 12:21:11.842446 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.842423 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 12:21:11.844860 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.844841 2569 fs.go:135] Filesystem UUIDs: map[167d9a8e-2555-4d55-9e3b-11287cbae8a6:/dev/nvme0n1p4 52681be0-8e71-4017-acab-f4e903a529f4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 12:21:11.844920 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.844860 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 12:21:11.849624 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.849501 2569 manager.go:216] Machine: {Timestamp:2026-06-11 12:21:11.848269317 +0000 UTC m=+0.301880403 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199856 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24452364c71b252d6ee318b6d77fcd SystemUUID:ec244523-64c7-1b25-2d6e-e318b6d77fcd BootID:ba33472a-d01a-4ff5-af97-11e7922b330f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:4f:9c:f2:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:4f:9c:f2:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:84:ec:21:49:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 12:21:11.849624 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.849617 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 12:21:11.849743 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.849732 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 12:21:11.852681 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.852665 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:21:11.853010 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.852988 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 12:21:11.853140 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.853015 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 12:21:11.853727 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.853718 2569 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 12:21:11.853756 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.853729 2569 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 12:21:11.853756 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.853736 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:21:11.854404 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.854395 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:21:11.855216 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.855204 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 12:21:11.858124 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858114 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:21:11.858403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858394 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 12:21:11.858433 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858423 2569 kubelet.go:486] "Attempting to sync node with API server" Jun 11 12:21:11.858462 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858433 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 12:21:11.858462 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858443 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 12:21:11.858462 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858453 2569 kubelet.go:398] "Adding apiserver pod source" Jun 11 12:21:11.858462 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858460 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 12:21:11.858838 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858827 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:21:11.858872 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.858848 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:21:11.861902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.861884 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 12:21:11.863673 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.863659 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 12:21:11.863724 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.863688 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 12:21:11.864754 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864743 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 12:21:11.864788 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864760 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 12:21:11.864788 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864767 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 12:21:11.864788 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864772 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 12:21:11.864788 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864780 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 12:21:11.864788 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864785 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 12:21:11.864902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864793 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 12:21:11.864902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864797 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 12:21:11.864902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864803 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 12:21:11.864902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864809 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 12:21:11.864902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864816 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 12:21:11.864902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.864821 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 12:21:11.865425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.865416 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 12:21:11.865458 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.865427 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 12:21:11.868715 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.868697 2569 server.go:1268] "Started kubelet" Jun 11 12:21:11.868805 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.868776 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 12:21:11.868805 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.868769 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 12:21:11.868878 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.868821 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 12:21:11.869513 ip-10-0-132-239 systemd[1]: Started Kubernetes Kubelet. Jun 11 12:21:11.870369 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.870351 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 12:21:11.870510 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.870452 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 12:21:11.870510 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.870461 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 12:21:11.870640 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.870615 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 12:21:11.871496 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.871469 2569 server.go:310] "Adding debug handlers to kubelet server" Jun 11 12:21:11.875385 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.875362 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 12:21:11.875691 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.875675 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 12:21:11.875762 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.875695 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 12:21:11.875804 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.875751 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:11.876190 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876172 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 12:21:11.876280 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876172 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 12:21:11.876280 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876211 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 12:21:11.876373 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876326 2569 reconstruct.go:97] "Volume reconstruction finished" Jun 11 12:21:11.876373 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876332 2569 reconciler.go:29] "Reconciler: start to sync state" Jun 11 12:21:11.876678 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876661 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 12:21:11.876787 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876776 2569 factory.go:55] Registering systemd factory Jun 11 12:21:11.876864 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.876847 2569 factory.go:223] Registration of the systemd container factory successfully Jun 11 12:21:11.877124 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.877112 2569 factory.go:153] Registering CRI-O factory Jun 11 12:21:11.877163 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.877126 2569 factory.go:223] Registration of the crio container factory successfully Jun 11 12:21:11.877163 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.877155 2569 factory.go:103] Registering Raw factory Jun 11 12:21:11.877232 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.877179 2569 manager.go:1196] Started watching for new ooms in manager Jun 11 12:21:11.877753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.877730 2569 manager.go:349] Starting recovery of all containers Jun 11 12:21:11.878112 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.876916 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-239.ec2.internal.18b80633ba984e83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-239.ec2.internal,UID:ip-10-0-132-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-239.ec2.internal,},FirstTimestamp:2026-06-11 12:21:11.868673667 +0000 UTC m=+0.322284752,LastTimestamp:2026-06-11 12:21:11.868673667 +0000 UTC m=+0.322284752,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-239.ec2.internal,}" Jun 11 12:21:11.879764 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.879747 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wlx92" Jun 11 12:21:11.880827 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.880802 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 12:21:11.881080 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.881060 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 12:21:11.887914 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.887728 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wlx92" Jun 11 12:21:11.890515 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.890493 2569 manager.go:354] Recovery completed Jun 11 12:21:11.894935 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.894923 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:11.897737 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.897627 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:11.897737 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.897661 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:11.897737 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.897672 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:11.898240 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.898226 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 12:21:11.898240 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.898238 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 12:21:11.898349 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.898253 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:21:11.898349 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.898269 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:11.899388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.899369 2569 policy_none.go:49] "None policy: Start" Jun 11 12:21:11.899388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.899387 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 12:21:11.899489 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.899403 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 12:21:11.899489 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.899437 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:11.899489 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.899464 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:11.899489 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.899481 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:11.899920 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.899854 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-239.ec2.internal.18b80633bc5250b3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-239.ec2.internal,UID:ip-10-0-132-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-239.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-239.ec2.internal,},FirstTimestamp:2026-06-11 12:21:11.897641139 +0000 UTC m=+0.351252228,LastTimestamp:2026-06-11 12:21:11.897641139 +0000 UTC m=+0.351252228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-239.ec2.internal,}" Jun 11 12:21:11.900448 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.900436 2569 policy_none.go:47] "Start" Jun 11 12:21:11.939285 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939267 2569 manager.go:337] "Starting Device Plugin manager" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.939313 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939326 2569 server.go:87] "Starting device plugin registration server" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939623 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939636 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939777 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939861 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.939871 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.940471 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.940518 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.943469 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.944780 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.944810 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.944825 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 12:21:11.946899 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:11.944877 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 12:21:11.947330 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:11.947119 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:21:12.040607 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.040559 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:12.041818 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.041800 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:12.041942 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.041835 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:12.041942 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.041867 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:12.041942 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.041897 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.044964 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.044937 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal"] Jun 11 12:21:12.045025 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.045008 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:12.046371 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.046356 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:12.046442 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.046383 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:12.046442 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.046396 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:12.047700 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.047688 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:12.047844 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.047829 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.047879 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.047870 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:12.048937 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.048920 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:12.048937 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.048929 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:12.049040 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.048954 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:12.049040 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.048965 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:12.049040 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.048968 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:12.049040 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.048986 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:12.050256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.050243 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.050313 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.050271 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:21:12.050608 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.050595 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.050654 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.050614 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-239.ec2.internal\": node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.051021 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.051006 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:21:12.051111 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.051030 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:21:12.051111 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.051039 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:21:12.068497 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.068477 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.072165 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.072148 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-239.ec2.internal\" not found" node="ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.075730 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.075712 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-239.ec2.internal\" not found" node="ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.078205 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.078187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c458f95fdad97edba52b10af4af06ea-config\") pod \"kube-apiserver-proxy-ip-10-0-132-239.ec2.internal\" (UID: \"3c458f95fdad97edba52b10af4af06ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.078267 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.078211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0dd22e2db0d094ca5cd5c3f6d80facd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal\" (UID: \"0dd22e2db0d094ca5cd5c3f6d80facd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.078267 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.078228 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd22e2db0d094ca5cd5c3f6d80facd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal\" (UID: \"0dd22e2db0d094ca5cd5c3f6d80facd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.169243 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.169209 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.178589 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.178558 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0dd22e2db0d094ca5cd5c3f6d80facd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal\" (UID: \"0dd22e2db0d094ca5cd5c3f6d80facd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.178753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.178591 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd22e2db0d094ca5cd5c3f6d80facd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal\" (UID: \"0dd22e2db0d094ca5cd5c3f6d80facd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.178753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.178614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c458f95fdad97edba52b10af4af06ea-config\") pod \"kube-apiserver-proxy-ip-10-0-132-239.ec2.internal\" (UID: \"3c458f95fdad97edba52b10af4af06ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.178753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.178684 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c458f95fdad97edba52b10af4af06ea-config\") pod \"kube-apiserver-proxy-ip-10-0-132-239.ec2.internal\" (UID: \"3c458f95fdad97edba52b10af4af06ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.178753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.178688 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd22e2db0d094ca5cd5c3f6d80facd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal\" (UID: \"0dd22e2db0d094ca5cd5c3f6d80facd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.178753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.178741 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0dd22e2db0d094ca5cd5c3f6d80facd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal\" (UID: \"0dd22e2db0d094ca5cd5c3f6d80facd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.269508 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.269469 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.370519 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.370422 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.376626 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.376601 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.379844 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.379817 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.471241 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.471196 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.571842 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.571814 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.672601 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.672567 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.773386 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.773350 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.824893 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.824863 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 12:21:12.825465 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.825031 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:21:12.839845 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.839820 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:21:12.873760 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:12.873726 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-239.ec2.internal\" not found" Jun 11 12:21:12.890754 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.890714 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 12:16:11 +0000 UTC" deadline="2027-11-30 02:44:48.105921482 +0000 UTC" Jun 11 12:21:12.890754 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.890745 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12878h23m35.215179603s" Jun 11 12:21:12.901391 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:12.901353 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c458f95fdad97edba52b10af4af06ea.slice/crio-ecb30a200b840484bc9b3946779fac76b1096bf4a9967195e11e9619b011dc1c WatchSource:0}: Error finding container ecb30a200b840484bc9b3946779fac76b1096bf4a9967195e11e9619b011dc1c: Status 404 returned error can't find the container with id ecb30a200b840484bc9b3946779fac76b1096bf4a9967195e11e9619b011dc1c Jun 11 12:21:12.901633 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:12.901611 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd22e2db0d094ca5cd5c3f6d80facd3.slice/crio-3de199f7eb223a99d3060bd7f8594bca2f55d87f74053f091454404aa4811f04 WatchSource:0}: Error finding container 3de199f7eb223a99d3060bd7f8594bca2f55d87f74053f091454404aa4811f04: Status 404 returned error can't find the container with id 3de199f7eb223a99d3060bd7f8594bca2f55d87f74053f091454404aa4811f04 Jun 11 12:21:12.906921 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.906903 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:21:12.948798 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.948749 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" event={"ID":"0dd22e2db0d094ca5cd5c3f6d80facd3","Type":"ContainerStarted","Data":"3de199f7eb223a99d3060bd7f8594bca2f55d87f74053f091454404aa4811f04"} Jun 11 12:21:12.949777 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.949754 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" event={"ID":"3c458f95fdad97edba52b10af4af06ea","Type":"ContainerStarted","Data":"ecb30a200b840484bc9b3946779fac76b1096bf4a9967195e11e9619b011dc1c"} Jun 11 12:21:12.959020 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.958999 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:21:12.976412 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.976385 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" Jun 11 12:21:12.989265 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.989239 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:21:12.995024 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:12.994994 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" Jun 11 12:21:13.004889 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.004868 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:21:13.125925 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.125897 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:21:13.859980 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.859937 2569 apiserver.go:52] "Watching apiserver" Jun 11 12:21:13.868695 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.868667 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 12:21:13.870525 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.870489 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vvcmm","kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal","openshift-dns/node-resolver-xj49p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal","openshift-multus/multus-9zjlj","openshift-multus/network-metrics-daemon-fc84k","openshift-network-operator/iptables-alerter-z6c49","kube-system/global-pull-secret-syncer-rdt4q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs","openshift-cluster-node-tuning-operator/tuned-bz27v","openshift-image-registry/node-ca-ck4gh","openshift-multus/multus-additional-cni-plugins-lz4bf","openshift-network-diagnostics/network-check-target-qswmv","openshift-ovn-kubernetes/ovnkube-node-q5wtw"] Jun 11 12:21:13.871988 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.871964 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:13.873395 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.873372 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.874640 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.874608 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.875166 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.875144 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 12:21:13.875354 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.875330 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9zwg\"" Jun 11 12:21:13.875456 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.875379 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 12:21:13.875858 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.875840 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:13.875957 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:13.875916 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:13.876018 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.875961 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 12:21:13.876018 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.875971 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.876101 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.876018 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-24gst\"" Jun 11 12:21:13.876181 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.876158 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.877055 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.877035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.877172 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.877155 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.877276 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.877181 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.877578 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.877489 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 12:21:13.877759 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.877670 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 12:21:13.877759 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.877681 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b24vq\"" Jun 11 12:21:13.878302 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.878284 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:13.878389 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:13.878363 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:13.880006 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.879839 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.880006 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.879851 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c56jm\"" Jun 11 12:21:13.880006 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.879880 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.880489 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.880334 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 12:21:13.881260 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.881243 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.882799 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.882780 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.883597 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.883575 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.883958 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.883940 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 12:21:13.884042 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.883974 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.884042 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.884038 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6rjdl\"" Jun 11 12:21:13.884237 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.884211 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:13.885853 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.885833 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.886046 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.886029 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.886175 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.886151 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lhdlv\"" Jun 11 12:21:13.887877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.886908 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 12:21:13.887877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.887746 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.887877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.887762 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.888061 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.888014 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v6t62\"" Jun 11 12:21:13.888119 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.888048 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:21:13.888579 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.888496 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.889848 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889713 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-netns\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.889848 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889747 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-hostroot\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.889848 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889773 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46jdz\" (UniqueName: \"kubernetes.io/projected/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-kube-api-access-46jdz\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.889848 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-cni-bin\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.889848 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-etc-kubernetes\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgbpq\" (UniqueName: \"kubernetes.io/projected/e357e063-6064-47cf-8dc3-09684c032c6c-kube-api-access-lgbpq\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889893 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xnlk\" (UniqueName: \"kubernetes.io/projected/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-kube-api-access-4xnlk\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-system-cni-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889937 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-k8s-cni-cncf-io\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889977 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.889998 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/916fca5e-e135-4925-bf87-5ba50b1e3925-hosts-file\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890020 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmvp\" (UniqueName: \"kubernetes.io/projected/916fca5e-e135-4925-bf87-5ba50b1e3925-kube-api-access-2nmvp\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-iptables-alerter-script\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890094 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-host-slash\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/830001bf-208d-4991-8162-45e60d6c4314-konnectivity-ca\") pod \"konnectivity-agent-vvcmm\" (UID: \"830001bf-208d-4991-8162-45e60d6c4314\") " pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:13.890141 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-kubelet\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-os-release\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-daemon-config\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890231 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-multus-certs\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890271 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916fca5e-e135-4925-bf87-5ba50b1e3925-tmp-dir\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890291 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-socket-dir-parent\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890347 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-cni-multus\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890378 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-conf-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/830001bf-208d-4991-8162-45e60d6c4314-agent-certs\") pod \"konnectivity-agent-vvcmm\" (UID: \"830001bf-208d-4991-8162-45e60d6c4314\") " pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-cni-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-cnibin\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.890652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890470 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-cni-binary-copy\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.891167 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.890797 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 12:21:13.891167 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.891092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:13.891288 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:13.891199 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:13.891437 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.891410 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 12:21:13.891437 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.891425 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zsz48\"" Jun 11 12:21:13.892826 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.892809 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.895245 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.895210 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 12:21:13.895245 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.895232 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 12:21:13.895581 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.895563 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 12:21:13.895581 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.895574 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5fkz\"" Jun 11 12:21:13.895726 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.895575 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 12:21:13.895908 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.895887 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 12:21:13.896806 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.896787 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 12:21:13.908017 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.907996 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h2gpm" Jun 11 12:21:13.916743 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.916721 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h2gpm" Jun 11 12:21:13.977236 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.977204 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 12:21:13.990690 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990656 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysctl-conf\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.990859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-run\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.990859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.990859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-env-overrides\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.990859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovn-node-metrics-cert\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.990859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990812 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-os-release\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.990859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990838 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-daemon-config\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990911 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-system-cni-dir\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-os-release\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990944 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-os-release\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.990972 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-socket-dir-parent\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991017 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-conf-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-etc-selinux\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991062 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-socket-dir-parent\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-conf-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991108 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysconfig\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f88c2ec3-858c-4985-88a4-a7521051c799-host\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cnibin\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991236 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991273 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-cni-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991300 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-hostroot\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46jdz\" (UniqueName: \"kubernetes.io/projected/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-kube-api-access-46jdz\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991350 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-systemd\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991360 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-hostroot\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991366 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-cni-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-cni-bin\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-etc-kubernetes\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-var-lib-kubelet\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991473 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f88c2ec3-858c-4985-88a4-a7521051c799-serviceca\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991476 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-cni-bin\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.991522 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991498 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-dbus\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991532 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-multus-daemon-config\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991578 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-etc-kubernetes\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991530 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-system-cni-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991641 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-system-cni-dir\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991680 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-sys-fs\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-modprobe-d\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991755 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-host\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991785 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-tuned\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-node-log\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/916fca5e-e135-4925-bf87-5ba50b1e3925-hosts-file\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmvp\" (UniqueName: \"kubernetes.io/projected/916fca5e-e135-4925-bf87-5ba50b1e3925-kube-api-access-2nmvp\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-socket-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991921 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shpjz\" (UniqueName: \"kubernetes.io/projected/15051e88-143d-4173-a1c2-c4cf1bf74e0a-kube-api-access-shpjz\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991954 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.992212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991922 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/916fca5e-e135-4925-bf87-5ba50b1e3925-hosts-file\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.991996 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-device-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992025 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-kubelet-config\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256tm\" (UniqueName: \"kubernetes.io/projected/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-kube-api-access-256tm\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-cni-bin\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992111 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/830001bf-208d-4991-8162-45e60d6c4314-konnectivity-ca\") pod \"konnectivity-agent-vvcmm\" (UID: \"830001bf-208d-4991-8162-45e60d6c4314\") " pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992151 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-kubelet\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-registration-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992200 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-kubelet\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-run-ovn-kubernetes\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-multus-certs\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992342 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysctl-d\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992380 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15051e88-143d-4173-a1c2-c4cf1bf74e0a-tmp\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992402 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-multus-certs\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992462 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-kubelet\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.993152 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992565 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-var-lib-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992597 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916fca5e-e135-4925-bf87-5ba50b1e3925-tmp-dir\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992638 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-cni-multus\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992664 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/830001bf-208d-4991-8162-45e60d6c4314-konnectivity-ca\") pod \"konnectivity-agent-vvcmm\" (UID: \"830001bf-208d-4991-8162-45e60d6c4314\") " pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992706 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-var-lib-cni-multus\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992733 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992759 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/830001bf-208d-4991-8162-45e60d6c4314-agent-certs\") pod \"konnectivity-agent-vvcmm\" (UID: \"830001bf-208d-4991-8162-45e60d6c4314\") " pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-cnibin\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992804 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-cni-binary-copy\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-netns\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992829 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916fca5e-e135-4925-bf87-5ba50b1e3925-tmp-dir\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992829 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-cnibin\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xnlk\" (UniqueName: \"kubernetes.io/projected/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-kube-api-access-4xnlk\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992909 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-netns\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992940 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-cni-netd\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.992967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgbpq\" (UniqueName: \"kubernetes.io/projected/e357e063-6064-47cf-8dc3-09684c032c6c-kube-api-access-lgbpq\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993013 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-systemd-units\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993071 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 12:21:13.993790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-slash\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993201 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-systemd\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993244 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-ovn\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993281 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-k8s-cni-cncf-io\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993311 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-cni-binary-copy\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993375 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6gb6\" (UniqueName: \"kubernetes.io/projected/0cbe83ff-a8e3-44eb-857c-e62a2f189623-kube-api-access-f6gb6\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993393 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-host-run-k8s-cni-cncf-io\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993414 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-run-netns\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993445 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:13.993467 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993471 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovnkube-config\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovnkube-script-lib\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993532 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-kubernetes\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993571 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-sys\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:13.993604 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:21:14.493571202 +0000 UTC m=+2.947182281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:13.994483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993643 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-lib-modules\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993664 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2zds\" (UniqueName: \"kubernetes.io/projected/f88c2ec3-858c-4985-88a4-a7521051c799-kube-api-access-z2zds\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993684 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-etc-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993704 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmppw\" (UniqueName: \"kubernetes.io/projected/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-kube-api-access-zmppw\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-iptables-alerter-script\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-host-slash\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-log-socket\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.993847 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-host-slash\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.995165 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.994244 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-iptables-alerter-script\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:13.996775 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:13.996748 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/830001bf-208d-4991-8162-45e60d6c4314-agent-certs\") pod \"konnectivity-agent-vvcmm\" (UID: \"830001bf-208d-4991-8162-45e60d6c4314\") " pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:14.000112 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.000090 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46jdz\" (UniqueName: \"kubernetes.io/projected/4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f-kube-api-access-46jdz\") pod \"multus-9zjlj\" (UID: \"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f\") " pod="openshift-multus/multus-9zjlj" Jun 11 12:21:14.000270 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.000246 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmvp\" (UniqueName: \"kubernetes.io/projected/916fca5e-e135-4925-bf87-5ba50b1e3925-kube-api-access-2nmvp\") pod \"node-resolver-xj49p\" (UID: \"916fca5e-e135-4925-bf87-5ba50b1e3925\") " pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:14.000837 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.000813 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xnlk\" (UniqueName: \"kubernetes.io/projected/c11e8484-b0ca-4da3-abd4-cbccfd7b015f-kube-api-access-4xnlk\") pod \"iptables-alerter-z6c49\" (UID: \"c11e8484-b0ca-4da3-abd4-cbccfd7b015f\") " pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:14.001911 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.001892 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgbpq\" (UniqueName: \"kubernetes.io/projected/e357e063-6064-47cf-8dc3-09684c032c6c-kube-api-access-lgbpq\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:14.094633 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094598 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-etc-selinux\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.094633 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094634 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysconfig\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094656 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f88c2ec3-858c-4985-88a4-a7521051c799-host\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cnibin\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094745 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f88c2ec3-858c-4985-88a4-a7521051c799-host\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-etc-selinux\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094784 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cnibin\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094745 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysconfig\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094789 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.094810 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-systemd\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094848 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-var-lib-kubelet\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094857 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-systemd\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.094874 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.094871 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:14.594848958 +0000 UTC m=+3.048460046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094889 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-var-lib-kubelet\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094927 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f88c2ec3-858c-4985-88a4-a7521051c799-serviceca\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094951 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-dbus\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094971 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.094998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-sys-fs\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095017 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-modprobe-d\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095059 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-host\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-tuned\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095089 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-sys-fs\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095104 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095111 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-dbus\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095121 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-modprobe-d\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095125 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-host\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-node-log\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095171 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-socket-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.095571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095193 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shpjz\" (UniqueName: \"kubernetes.io/projected/15051e88-143d-4173-a1c2-c4cf1bf74e0a-kube-api-access-shpjz\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095212 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-node-log\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095245 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-device-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095270 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-kubelet-config\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-256tm\" (UniqueName: \"kubernetes.io/projected/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-kube-api-access-256tm\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095301 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-socket-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095318 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-cni-bin\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095347 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-registration-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095361 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-kubelet-config\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095372 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-run-ovn-kubernetes\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095402 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-device-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095429 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-cni-bin\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095467 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095480 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f88c2ec3-858c-4985-88a4-a7521051c799-serviceca\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysctl-d\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095598 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-run-ovn-kubernetes\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.096306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095609 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15051e88-143d-4173-a1c2-c4cf1bf74e0a-tmp\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095679 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-kubelet\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095700 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-var-lib-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095757 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysctl-d\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095758 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-cni-netd\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095795 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-cni-netd\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-systemd-units\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-slash\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095844 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0cbe83ff-a8e3-44eb-857c-e62a2f189623-registration-dir\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-systemd\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095857 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-kubelet\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095875 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-systemd\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-ovn\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095912 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-ovn\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095920 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6gb6\" (UniqueName: \"kubernetes.io/projected/0cbe83ff-a8e3-44eb-857c-e62a2f189623-kube-api-access-f6gb6\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.097091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-run-netns\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095948 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-var-lib-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095990 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-slash\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.095992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovnkube-config\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096017 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovnkube-script-lib\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096024 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-systemd-units\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096039 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-kubernetes\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-sys\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096066 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-run-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096085 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-lib-modules\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096115 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-host-run-netns\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096136 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2zds\" (UniqueName: \"kubernetes.io/projected/f88c2ec3-858c-4985-88a4-a7521051c799-kube-api-access-z2zds\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096166 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-etc-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096190 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-sys\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096191 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmppw\" (UniqueName: \"kubernetes.io/projected/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-kube-api-access-zmppw\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096237 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-log-socket\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysctl-conf\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.097867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096291 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-run\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096318 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-env-overrides\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovn-node-metrics-cert\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096390 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-etc-openvswitch\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096401 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-system-cni-dir\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096427 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-os-release\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096429 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096446 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-kubernetes\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096345 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096490 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-system-cni-dir\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096495 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-lib-modules\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096497 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-log-socket\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096559 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-run\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096583 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-os-release\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096672 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-sysctl-conf\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096734 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovnkube-script-lib\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.098687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.096990 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovnkube-config\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.099427 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.097019 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.099427 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.097054 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-env-overrides\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.099427 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.097805 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15051e88-143d-4173-a1c2-c4cf1bf74e0a-etc-tuned\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.099427 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.098785 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15051e88-143d-4173-a1c2-c4cf1bf74e0a-tmp\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.099427 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.098844 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-ovn-node-metrics-cert\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.102375 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.102356 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:21:14.103537 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.103515 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:14.103537 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.103560 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:14.103758 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.103574 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:14.103758 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.103639 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:14.603621072 +0000 UTC m=+3.057232147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:14.109798 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.109725 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-256tm\" (UniqueName: \"kubernetes.io/projected/aa330ca4-0d93-41d6-a549-d8e0ec4324e0-kube-api-access-256tm\") pod \"multus-additional-cni-plugins-lz4bf\" (UID: \"aa330ca4-0d93-41d6-a549-d8e0ec4324e0\") " pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.109894 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.109858 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2zds\" (UniqueName: \"kubernetes.io/projected/f88c2ec3-858c-4985-88a4-a7521051c799-kube-api-access-z2zds\") pod \"node-ca-ck4gh\" (UID: \"f88c2ec3-858c-4985-88a4-a7521051c799\") " pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.110356 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.110271 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shpjz\" (UniqueName: \"kubernetes.io/projected/15051e88-143d-4173-a1c2-c4cf1bf74e0a-kube-api-access-shpjz\") pod \"tuned-bz27v\" (UID: \"15051e88-143d-4173-a1c2-c4cf1bf74e0a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.110621 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.110596 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmppw\" (UniqueName: \"kubernetes.io/projected/4a61bdef-01f0-46f1-bcf2-2356c7de8beb-kube-api-access-zmppw\") pod \"ovnkube-node-q5wtw\" (UID: \"4a61bdef-01f0-46f1-bcf2-2356c7de8beb\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.111037 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.111012 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6gb6\" (UniqueName: \"kubernetes.io/projected/0cbe83ff-a8e3-44eb-857c-e62a2f189623-kube-api-access-f6gb6\") pod \"aws-ebs-csi-driver-node-tznrs\" (UID: \"0cbe83ff-a8e3-44eb-857c-e62a2f189623\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.184383 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.184348 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:14.192332 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.192305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xj49p" Jun 11 12:21:14.200873 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.200850 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ck4gh" Jun 11 12:21:14.206733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.206715 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zjlj" Jun 11 12:21:14.213390 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.213371 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6c49" Jun 11 12:21:14.219297 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.219273 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" Jun 11 12:21:14.225207 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.225188 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz27v" Jun 11 12:21:14.230849 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.230830 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" Jun 11 12:21:14.235595 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.235575 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:14.499112 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.499076 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:14.499308 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.499212 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:14.499308 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.499277 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:21:15.499259607 +0000 UTC m=+3.952870688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:14.599875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.599837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.600061 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.600016 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:14.600191 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.600104 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:15.60008431 +0000 UTC m=+4.053695387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:14.663291 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.663263 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a61bdef_01f0_46f1_bcf2_2356c7de8beb.slice/crio-e707c11fd74eaf590831b30561fc54cfd22814ad85abb73246206ed76a02b555 WatchSource:0}: Error finding container e707c11fd74eaf590831b30561fc54cfd22814ad85abb73246206ed76a02b555: Status 404 returned error can't find the container with id e707c11fd74eaf590831b30561fc54cfd22814ad85abb73246206ed76a02b555 Jun 11 12:21:14.676975 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.676684 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11e8484_b0ca_4da3_abd4_cbccfd7b015f.slice/crio-a74fae59b317817d08632f86487f9a537f7d012e85db986c36ff00555d6578b9 WatchSource:0}: Error finding container a74fae59b317817d08632f86487f9a537f7d012e85db986c36ff00555d6578b9: Status 404 returned error can't find the container with id a74fae59b317817d08632f86487f9a537f7d012e85db986c36ff00555d6578b9 Jun 11 12:21:14.679357 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.679336 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbe83ff_a8e3_44eb_857c_e62a2f189623.slice/crio-a79777f02a7a701e3b33dd2fa244347ebd839d526371af6a32d0af2dd3bcf116 WatchSource:0}: Error finding container a79777f02a7a701e3b33dd2fa244347ebd839d526371af6a32d0af2dd3bcf116: Status 404 returned error can't find the container with id a79777f02a7a701e3b33dd2fa244347ebd839d526371af6a32d0af2dd3bcf116 Jun 11 12:21:14.682718 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.682693 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15051e88_143d_4173_a1c2_c4cf1bf74e0a.slice/crio-30acfe7b0709a4322f88ec51a5c62478ad5e4ddde6d66348e8593b6db6f7d314 WatchSource:0}: Error finding container 30acfe7b0709a4322f88ec51a5c62478ad5e4ddde6d66348e8593b6db6f7d314: Status 404 returned error can't find the container with id 30acfe7b0709a4322f88ec51a5c62478ad5e4ddde6d66348e8593b6db6f7d314 Jun 11 12:21:14.683639 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.683612 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916fca5e_e135_4925_bf87_5ba50b1e3925.slice/crio-9fbe3bd7e09d183c5798067420b4ca1d473fa3d34dccddc58317973db4568501 WatchSource:0}: Error finding container 9fbe3bd7e09d183c5798067420b4ca1d473fa3d34dccddc58317973db4568501: Status 404 returned error can't find the container with id 9fbe3bd7e09d183c5798067420b4ca1d473fa3d34dccddc58317973db4568501 Jun 11 12:21:14.685391 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.685217 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa330ca4_0d93_41d6_a549_d8e0ec4324e0.slice/crio-42ffbe78cc46796be3275c288a2b2f5ef3cd29f676e6823d69932745eb81f5db WatchSource:0}: Error finding container 42ffbe78cc46796be3275c288a2b2f5ef3cd29f676e6823d69932745eb81f5db: Status 404 returned error can't find the container with id 42ffbe78cc46796be3275c288a2b2f5ef3cd29f676e6823d69932745eb81f5db Jun 11 12:21:14.686107 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.686075 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4044c1b6_ed15_4c57_9ed6_bc2a69c66f5f.slice/crio-fdc0a5d00f2a4e06693e36b43bf930b2d4584dbe2479cefff5eb21d70692ea81 WatchSource:0}: Error finding container fdc0a5d00f2a4e06693e36b43bf930b2d4584dbe2479cefff5eb21d70692ea81: Status 404 returned error can't find the container with id fdc0a5d00f2a4e06693e36b43bf930b2d4584dbe2479cefff5eb21d70692ea81 Jun 11 12:21:14.687320 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.687301 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830001bf_208d_4991_8162_45e60d6c4314.slice/crio-f1fbeb81b4b2f22324bf0ff55a78fdb053695a144e96e7581cc66a4086a796f1 WatchSource:0}: Error finding container f1fbeb81b4b2f22324bf0ff55a78fdb053695a144e96e7581cc66a4086a796f1: Status 404 returned error can't find the container with id f1fbeb81b4b2f22324bf0ff55a78fdb053695a144e96e7581cc66a4086a796f1 Jun 11 12:21:14.688754 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:14.688734 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88c2ec3_858c_4985_88a4_a7521051c799.slice/crio-755a25e0149838245e1de12cb6f57f819ded42d719b4e79373412b54aececca9 WatchSource:0}: Error finding container 755a25e0149838245e1de12cb6f57f819ded42d719b4e79373412b54aececca9: Status 404 returned error can't find the container with id 755a25e0149838245e1de12cb6f57f819ded42d719b4e79373412b54aececca9 Jun 11 12:21:14.700694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.700672 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:14.700786 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.700775 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:14.700823 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.700792 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:14.700823 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.700800 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:14.700883 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.700838 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:15.700825863 +0000 UTC m=+4.154436938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:14.919501 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.919286 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:16:13 +0000 UTC" deadline="2027-11-23 00:56:11.635950731 +0000 UTC" Jun 11 12:21:14.919785 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.919504 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12708h34m56.716452984s" Jun 11 12:21:14.945397 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.945374 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:14.945507 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:14.945474 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:14.953642 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.953614 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ck4gh" event={"ID":"f88c2ec3-858c-4985-88a4-a7521051c799","Type":"ContainerStarted","Data":"755a25e0149838245e1de12cb6f57f819ded42d719b4e79373412b54aececca9"} Jun 11 12:21:14.954444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.954419 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vvcmm" event={"ID":"830001bf-208d-4991-8162-45e60d6c4314","Type":"ContainerStarted","Data":"f1fbeb81b4b2f22324bf0ff55a78fdb053695a144e96e7581cc66a4086a796f1"} Jun 11 12:21:14.955199 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.955179 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerStarted","Data":"42ffbe78cc46796be3275c288a2b2f5ef3cd29f676e6823d69932745eb81f5db"} Jun 11 12:21:14.955902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.955883 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xj49p" event={"ID":"916fca5e-e135-4925-bf87-5ba50b1e3925","Type":"ContainerStarted","Data":"9fbe3bd7e09d183c5798067420b4ca1d473fa3d34dccddc58317973db4568501"} Jun 11 12:21:14.956732 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.956715 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz27v" event={"ID":"15051e88-143d-4173-a1c2-c4cf1bf74e0a","Type":"ContainerStarted","Data":"30acfe7b0709a4322f88ec51a5c62478ad5e4ddde6d66348e8593b6db6f7d314"} Jun 11 12:21:14.959659 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.959634 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" event={"ID":"0cbe83ff-a8e3-44eb-857c-e62a2f189623","Type":"ContainerStarted","Data":"a79777f02a7a701e3b33dd2fa244347ebd839d526371af6a32d0af2dd3bcf116"} Jun 11 12:21:14.961923 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.961901 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" event={"ID":"3c458f95fdad97edba52b10af4af06ea","Type":"ContainerStarted","Data":"b933fe569a26e72923fb8ca829563e19ec9e127657ea39b920bfd4752b4ae011"} Jun 11 12:21:14.962886 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.962868 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zjlj" event={"ID":"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f","Type":"ContainerStarted","Data":"fdc0a5d00f2a4e06693e36b43bf930b2d4584dbe2479cefff5eb21d70692ea81"} Jun 11 12:21:14.963777 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.963758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6c49" event={"ID":"c11e8484-b0ca-4da3-abd4-cbccfd7b015f","Type":"ContainerStarted","Data":"a74fae59b317817d08632f86487f9a537f7d012e85db986c36ff00555d6578b9"} Jun 11 12:21:14.964816 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.964799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"e707c11fd74eaf590831b30561fc54cfd22814ad85abb73246206ed76a02b555"} Jun 11 12:21:14.966157 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.966139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" event={"ID":"0dd22e2db0d094ca5cd5c3f6d80facd3","Type":"ContainerStarted","Data":"0e297c75f397dc267739acfcf232a911f2787914f6dc3aa7bbdefd3d7ef629c9"} Jun 11 12:21:14.976800 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:14.976760 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-239.ec2.internal" podStartSLOduration=2.976747726 podStartE2EDuration="2.976747726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:14.976089777 +0000 UTC m=+3.429700874" watchObservedRunningTime="2026-06-11 12:21:14.976747726 +0000 UTC m=+3.430358822" Jun 11 12:21:15.506553 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.506498 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:15.506726 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.506693 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:15.506796 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.506758 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:21:17.506739755 +0000 UTC m=+5.960350834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:15.607084 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.607044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:15.607275 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.607194 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:15.607275 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.607259 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:17.607241451 +0000 UTC m=+6.060852548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:15.707582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.707531 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:15.707749 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.707715 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:15.707749 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.707736 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:15.707749 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.707748 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:15.707907 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.707808 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:17.707789096 +0000 UTC m=+6.161400184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:15.920728 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.920683 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:16:13 +0000 UTC" deadline="2027-11-22 20:44:12.29789243 +0000 UTC" Jun 11 12:21:15.920728 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.920727 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12704h22m56.377170685s" Jun 11 12:21:15.947481 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.947454 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:15.947648 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.947587 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:15.947991 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.947956 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:15.948074 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:15.948058 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:15.988325 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.988291 2569 generic.go:356] "Generic (PLEG): container finished" podID="0dd22e2db0d094ca5cd5c3f6d80facd3" containerID="0e297c75f397dc267739acfcf232a911f2787914f6dc3aa7bbdefd3d7ef629c9" exitCode=0 Jun 11 12:21:15.989310 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.989283 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" event={"ID":"0dd22e2db0d094ca5cd5c3f6d80facd3","Type":"ContainerDied","Data":"0e297c75f397dc267739acfcf232a911f2787914f6dc3aa7bbdefd3d7ef629c9"} Jun 11 12:21:15.989403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:15.989334 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" event={"ID":"0dd22e2db0d094ca5cd5c3f6d80facd3","Type":"ContainerStarted","Data":"f76b70d25d6ab51b89dacb7d5c5e613c5e467dd633887812b15522729b7d1c1c"} Jun 11 12:21:16.005903 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:16.005851 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-239.ec2.internal" podStartSLOduration=4.005832041 podStartE2EDuration="4.005832041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:16.004943803 +0000 UTC m=+4.458554901" watchObservedRunningTime="2026-06-11 12:21:16.005832041 +0000 UTC m=+4.459443139" Jun 11 12:21:16.945646 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:16.945613 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:16.946148 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:16.945739 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:17.525032 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:17.524439 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:17.525032 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.524597 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:17.525032 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.524659 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:21:21.524640778 +0000 UTC m=+9.978251868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:17.625800 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:17.625737 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:17.625977 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.625872 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:17.625977 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.625936 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:21.625917973 +0000 UTC m=+10.079529050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:17.726639 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:17.726552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:17.726803 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.726722 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:17.726803 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.726740 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:17.726803 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.726752 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:17.727017 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.726814 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:21.726794822 +0000 UTC m=+10.180405901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:17.946338 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:17.945204 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:17.946338 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:17.945204 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:17.946338 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.945343 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:17.946338 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:17.945382 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:18.945308 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:18.945275 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:18.945473 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:18.945403 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:19.945844 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:19.945813 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:19.946308 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:19.945945 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:19.946308 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:19.945990 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:19.946308 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:19.946114 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:20.944987 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:20.944944 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:20.945159 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:20.945065 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:21.555805 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:21.555731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:21.556248 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.555911 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:21.556248 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.555966 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:21:29.555948612 +0000 UTC m=+18.009559711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:21.656562 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:21.656518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:21.656731 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.656701 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:21.656795 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.656759 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:29.656741757 +0000 UTC m=+18.110352835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:21.757168 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:21.757070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:21.757329 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.757216 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:21.757329 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.757244 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:21.757329 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.757258 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:21.757329 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.757315 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:29.757299986 +0000 UTC m=+18.210911077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:21.948220 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:21.945563 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:21.948220 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.945744 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:21.948909 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:21.948883 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:21.949671 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:21.949623 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:22.945197 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:22.945167 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:22.945640 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:22.945281 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:23.945329 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:23.945300 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:23.945784 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:23.945439 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:23.945784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:23.945523 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:23.945784 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:23.945646 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:24.945557 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:24.945513 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:24.946002 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:24.945651 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:25.945190 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:25.945111 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:25.945344 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:25.945240 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:25.945344 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:25.945303 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:25.945449 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:25.945427 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:26.945800 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:26.945731 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:26.946313 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:26.945851 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:27.945994 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:27.945960 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:27.946369 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:27.946072 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:27.946369 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:27.946114 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:27.946369 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:27.946198 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:28.946159 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:28.945965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:28.946574 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:28.946235 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:29.028557 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.028498 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vvcmm" event={"ID":"830001bf-208d-4991-8162-45e60d6c4314","Type":"ContainerStarted","Data":"bed0ac3e536566c66a16a10ef68c4ae6f239a7bbefbc7701773fa959b7f66cec"} Jun 11 12:21:29.030071 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.030041 2569 generic.go:356] "Generic (PLEG): container finished" podID="aa330ca4-0d93-41d6-a549-d8e0ec4324e0" containerID="11afc54ea9ada4adea8df1a50b89162b71f89c6ec64634d3ed61a7936c955bdf" exitCode=0 Jun 11 12:21:29.030192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.030113 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerDied","Data":"11afc54ea9ada4adea8df1a50b89162b71f89c6ec64634d3ed61a7936c955bdf"} Jun 11 12:21:29.032051 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.031644 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xj49p" event={"ID":"916fca5e-e135-4925-bf87-5ba50b1e3925","Type":"ContainerStarted","Data":"fc8e0c91705265f5a757136367e94b3498fc57801c3f2f1331c33c3a6b09908c"} Jun 11 12:21:29.033288 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.033261 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz27v" event={"ID":"15051e88-143d-4173-a1c2-c4cf1bf74e0a","Type":"ContainerStarted","Data":"500b093ae914423790738661ab8aeaeccf8ed0aee9419ef07cc217b82ec654d7"} Jun 11 12:21:29.034758 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.034739 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" event={"ID":"0cbe83ff-a8e3-44eb-857c-e62a2f189623","Type":"ContainerStarted","Data":"ed289481d72027e8618a49d4f1811fbbf50d197fdadcaf3f662a9da8b04c460b"} Jun 11 12:21:29.036271 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.036245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zjlj" event={"ID":"4044c1b6-ed15-4c57-9ed6-bc2a69c66f5f","Type":"ContainerStarted","Data":"768a0ce1273c467462c0a97c72e8280d4c7ce54e59ff0391cdec87618135816f"} Jun 11 12:21:29.037849 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.037830 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ck4gh" event={"ID":"f88c2ec3-858c-4985-88a4-a7521051c799","Type":"ContainerStarted","Data":"950dc167b3675b706fd45584451ee9d10614d01577de1e0b16c011dd174d5e06"} Jun 11 12:21:29.055260 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.055217 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vvcmm" podStartSLOduration=7.507091472 podStartE2EDuration="17.055205771s" totalImagesPullingTime="9.548114299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:29.054998094 +0000 UTC m=+17.508609191" watchObservedRunningTime="2026-06-11 12:21:29.055205771 +0000 UTC m=+17.508816868" Jun 11 12:21:29.131219 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.131179 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bz27v" podStartSLOduration=3.561866679 podStartE2EDuration="17.131166569s" totalImagesPullingTime="13.56929989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:29.097474495 +0000 UTC m=+17.551085592" watchObservedRunningTime="2026-06-11 12:21:29.131166569 +0000 UTC m=+17.584777649" Jun 11 12:21:29.131857 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.131819 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9zjlj" podStartSLOduration=3.566250357 podStartE2EDuration="17.131807919s" totalImagesPullingTime="13.565557562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:29.130905255 +0000 UTC m=+17.584516351" watchObservedRunningTime="2026-06-11 12:21:29.131807919 +0000 UTC m=+17.585419016" Jun 11 12:21:29.191084 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.191043 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ck4gh" podStartSLOduration=3.701614378 podStartE2EDuration="17.191031129s" totalImagesPullingTime="13.489416751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:29.159120645 +0000 UTC m=+17.612731743" watchObservedRunningTime="2026-06-11 12:21:29.191031129 +0000 UTC m=+17.644642225" Jun 11 12:21:29.212197 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.212133 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xj49p" podStartSLOduration=3.7141259890000002 podStartE2EDuration="17.212122635s" totalImagesPullingTime="13.497996646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:29.211725251 +0000 UTC m=+17.665336347" watchObservedRunningTime="2026-06-11 12:21:29.212122635 +0000 UTC m=+17.665733730" Jun 11 12:21:29.566392 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.566371 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 12:21:29.618062 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.618034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:29.618190 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.618172 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:29.618258 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.618232 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:21:45.618217863 +0000 UTC m=+34.071828948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:29.718732 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.718673 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:29.718855 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.718830 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:29.718965 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.718896 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:45.718878072 +0000 UTC m=+34.172489162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:29.818966 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.818941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:29.819119 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.819102 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:29.819166 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.819128 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:29.819166 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.819143 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:29.819244 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.819210 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:45.819195717 +0000 UTC m=+34.272806792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:29.945896 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.945874 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:29.946039 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.945994 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:29.946122 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.946103 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:29.946257 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.946038 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T12:21:29.5663884Z","UUID":"ebfe5dfe-749e-4948-8ae4-5b6bc440908c","Handler":null,"Name":"","Endpoint":""} Jun 11 12:21:29.946921 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:29.946227 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:29.950171 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.950108 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 12:21:29.950171 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:29.950146 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 12:21:30.042721 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:30.042656 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" event={"ID":"0cbe83ff-a8e3-44eb-857c-e62a2f189623","Type":"ContainerStarted","Data":"8c704d83fd557da82e0cc2ee8ad92277ead024e83367428655588d9b1d460c9a"} Jun 11 12:21:30.045652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:30.045620 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6c49" event={"ID":"c11e8484-b0ca-4da3-abd4-cbccfd7b015f","Type":"ContainerStarted","Data":"82e776a8fdcb96f966c81a89447a4aea325996058f7269bca1ce23a6c24b94b0"} Jun 11 12:21:30.945022 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:30.944989 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:30.945197 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:30.945120 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:31.397451 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:31.397121 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:31.398028 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:31.397980 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:31.413019 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:31.412978 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z6c49" podStartSLOduration=5.908264588 podStartE2EDuration="19.412964044s" totalImagesPullingTime="13.504699456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:30.060900063 +0000 UTC m=+18.514511177" watchObservedRunningTime="2026-06-11 12:21:31.412964044 +0000 UTC m=+19.866575141" Jun 11 12:21:31.948033 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:31.948011 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:31.948267 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:31.948106 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:31.948267 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:31.948168 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:31.948367 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:31.948275 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:32.945892 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:32.945709 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:32.946264 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:32.946009 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:33.945438 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:33.945402 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:33.945438 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:33.945424 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:33.945669 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:33.945559 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:33.945669 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:33.945568 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:34.945986 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:34.945957 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:34.946327 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:34.946086 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:35.945556 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:35.945520 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:35.945808 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:35.945655 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:35.945808 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:35.945730 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:35.945916 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:35.945823 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:36.945017 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:36.944997 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:36.945305 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:36.945080 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:37.060346 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:37.060314 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerStarted","Data":"193f6c35f3b4f87d927233f559b3bae109711263a97edb84a6062a2d3bd799be"} Jun 11 12:21:37.062253 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:37.062225 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" event={"ID":"0cbe83ff-a8e3-44eb-857c-e62a2f189623","Type":"ContainerStarted","Data":"266abefd3b0a34f47c486ac0b6f8951d7d69a8326a625e81ff2cd724a9d840a1"} Jun 11 12:21:37.063600 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:37.063492 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"8b13f53f93994766ce8093364e77ce0deb3d2d359294db2c1429ce0b00c7a128"} Jun 11 12:21:37.081474 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:37.081435 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tznrs" podStartSLOduration=3.27734115 podStartE2EDuration="25.08142324s" totalImagesPullingTime="21.80408209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:37.081181195 +0000 UTC m=+25.534792303" watchObservedRunningTime="2026-06-11 12:21:37.08142324 +0000 UTC m=+25.535034336" Jun 11 12:21:37.945002 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:37.944977 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:37.945129 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:37.945095 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:37.945527 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:37.945149 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:37.945527 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:37.945222 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:38.068327 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068307 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:21:38.068630 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068609 2569 generic.go:356] "Generic (PLEG): container finished" podID="4a61bdef-01f0-46f1-bcf2-2356c7de8beb" containerID="a58f38f1cf3635e2c853140fbb994a85843f1956a7eaf4ed06c71351def95766" exitCode=1 Jun 11 12:21:38.068734 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068661 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"c2c4f4817eb117aebc478d0814f8c117747c4aaabc45ec7a34502ad1e3110cde"} Jun 11 12:21:38.068734 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068717 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"8dc4e0f347dd86c129a2d403989af078180054f8fc949e86266fccec14d869d7"} Jun 11 12:21:38.068832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068753 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"6951c4d84195532a541641223cde793052eba5ba357e16db72680a7b7be1a960"} Jun 11 12:21:38.068832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068789 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"59f896df3267524ecac2fcb2f14c9eb3a2130644c81c8f9ed9873a8af977bc39"} Jun 11 12:21:38.068832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.068824 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerDied","Data":"a58f38f1cf3635e2c853140fbb994a85843f1956a7eaf4ed06c71351def95766"} Jun 11 12:21:38.070289 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.070271 2569 generic.go:356] "Generic (PLEG): container finished" podID="aa330ca4-0d93-41d6-a549-d8e0ec4324e0" containerID="193f6c35f3b4f87d927233f559b3bae109711263a97edb84a6062a2d3bd799be" exitCode=0 Jun 11 12:21:38.070427 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.070350 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerDied","Data":"193f6c35f3b4f87d927233f559b3bae109711263a97edb84a6062a2d3bd799be"} Jun 11 12:21:38.945510 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:38.945479 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:38.945940 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:38.945583 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:39.945992 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:39.945964 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:39.946425 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:39.946093 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:39.946425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:39.946158 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:39.946425 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:39.946262 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:40.077174 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:40.077157 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:21:40.077567 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:40.077531 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"ed72bdae95a5f1ea5f71ca8398eb7472216000ec279732dd7bfc27ff4f0f0544"} Jun 11 12:21:40.079491 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:40.079468 2569 generic.go:356] "Generic (PLEG): container finished" podID="aa330ca4-0d93-41d6-a549-d8e0ec4324e0" containerID="274aef9ae41ed20bde1daba2739dc4cc2117a2ef682562c946b9a47428367775" exitCode=0 Jun 11 12:21:40.079581 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:40.079511 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerDied","Data":"274aef9ae41ed20bde1daba2739dc4cc2117a2ef682562c946b9a47428367775"} Jun 11 12:21:40.945508 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:40.945483 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:40.945663 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:40.945585 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:41.945931 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:41.945753 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:41.946450 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:41.945830 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:41.946450 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:41.946004 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:41.946450 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:41.946067 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:42.084989 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.084966 2569 generic.go:356] "Generic (PLEG): container finished" podID="aa330ca4-0d93-41d6-a549-d8e0ec4324e0" containerID="748f01c5c42c60aa5958b414e07adc8da2050b3be4a3bafbd452e5bcd2e6b3bd" exitCode=0 Jun 11 12:21:42.085087 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.085038 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerDied","Data":"748f01c5c42c60aa5958b414e07adc8da2050b3be4a3bafbd452e5bcd2e6b3bd"} Jun 11 12:21:42.088238 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.088221 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:21:42.088521 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.088503 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"bb019cd65e3b735440d879c3ebd6dff46a9642099818bbb00a153976204afb04"} Jun 11 12:21:42.088789 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.088768 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:42.088869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.088836 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:42.088869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.088840 2569 scope.go:117] "RemoveContainer" containerID="a58f38f1cf3635e2c853140fbb994a85843f1956a7eaf4ed06c71351def95766" Jun 11 12:21:42.104580 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.104563 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:42.945694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:42.945662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:42.945876 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:42.945773 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:43.094431 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.094400 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:21:43.094867 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.094820 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" event={"ID":"4a61bdef-01f0-46f1-bcf2-2356c7de8beb","Type":"ContainerStarted","Data":"17d127faef0eca7c81f30ba964ae40e9a945720b356161a90486cb622938f7cb"} Jun 11 12:21:43.095188 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.095165 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:43.111279 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.111246 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:21:43.122319 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.122280 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" podStartSLOduration=8.92054982 podStartE2EDuration="31.122267479s" totalImagesPullingTime="22.201717659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:43.121729394 +0000 UTC m=+31.575340509" watchObservedRunningTime="2026-06-11 12:21:43.122267479 +0000 UTC m=+31.575878575" Jun 11 12:21:43.385503 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.385431 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:43.385665 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.385598 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 12:21:43.386090 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.386070 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vvcmm" Jun 11 12:21:43.931337 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.931303 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qswmv"] Jun 11 12:21:43.931516 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.931419 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:43.931595 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:43.931516 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:43.933999 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.933976 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fc84k"] Jun 11 12:21:43.934132 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.934091 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:43.934208 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:43.934187 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:43.934844 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.934805 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rdt4q"] Jun 11 12:21:43.934961 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:43.934948 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:43.935062 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:43.935040 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:45.642771 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:45.642734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:45.643245 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.642907 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:45.643245 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.642985 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:22:17.642965068 +0000 UTC m=+66.096576145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:45.743632 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:45.743598 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:45.743752 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.743724 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:45.743805 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.743776 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret podName:d7f61177-3d0e-49e2-9800-2a9e1c7fac17 nodeName:}" failed. No retries permitted until 2026-06-11 12:22:17.74376241 +0000 UTC m=+66.197373489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret") pod "global-pull-secret-syncer-rdt4q" (UID: "d7f61177-3d0e-49e2-9800-2a9e1c7fac17") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:45.844186 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:45.844161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:45.844309 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.844291 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:45.844366 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.844318 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:45.844366 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.844331 2569 projected.go:196] Error preparing data for projected volume kube-api-access-2qf8j for pod openshift-network-diagnostics/network-check-target-qswmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:45.844451 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.844386 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j podName:dc5903d7-5aea-448d-8d49-e751071a463a nodeName:}" failed. No retries permitted until 2026-06-11 12:22:17.844368278 +0000 UTC m=+66.297979353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qf8j" (UniqueName: "kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j") pod "network-check-target-qswmv" (UID: "dc5903d7-5aea-448d-8d49-e751071a463a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:45.945239 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:45.945067 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:45.945364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:45.945067 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:45.945364 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.945320 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:45.945476 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:45.945168 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:45.945476 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.945381 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:45.945476 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:45.945463 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:46.104502 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:46.104473 2569 generic.go:356] "Generic (PLEG): container finished" podID="aa330ca4-0d93-41d6-a549-d8e0ec4324e0" containerID="b1901a4fd50de7ab3cb6c0eaf47d675800eaf6de94693f5ad56559a7ea2a050c" exitCode=0 Jun 11 12:21:46.104605 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:46.104531 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerDied","Data":"b1901a4fd50de7ab3cb6c0eaf47d675800eaf6de94693f5ad56559a7ea2a050c"} Jun 11 12:21:47.109214 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:47.109181 2569 generic.go:356] "Generic (PLEG): container finished" podID="aa330ca4-0d93-41d6-a549-d8e0ec4324e0" containerID="ef97c578bbd27cf10e15f72136c61b77f2ba04afe9260ef302b07a891a336787" exitCode=0 Jun 11 12:21:47.109883 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:47.109219 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerDied","Data":"ef97c578bbd27cf10e15f72136c61b77f2ba04afe9260ef302b07a891a336787"} Jun 11 12:21:47.945044 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:47.945017 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:47.945169 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:47.945044 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:47.945169 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:47.945017 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:47.945169 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:47.945109 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qswmv" podUID="dc5903d7-5aea-448d-8d49-e751071a463a" Jun 11 12:21:47.945270 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:47.945196 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rdt4q" podUID="d7f61177-3d0e-49e2-9800-2a9e1c7fac17" Jun 11 12:21:47.945270 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:47.945261 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:21:48.114604 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:48.114533 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" event={"ID":"aa330ca4-0d93-41d6-a549-d8e0ec4324e0","Type":"ContainerStarted","Data":"221dde54759a7235fffc7e315043f4f55de78be66c871bde18be9dc16d0f2efc"} Jun 11 12:21:48.139774 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:48.139731 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lz4bf" podStartSLOduration=8.854213793 podStartE2EDuration="36.139716898s" totalImagesPullingTime="27.285503105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:48.139259388 +0000 UTC m=+36.592870513" watchObservedRunningTime="2026-06-11 12:21:48.139716898 +0000 UTC m=+36.593327995" Jun 11 12:21:49.393142 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.393092 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-239.ec2.internal" event="NodeReady" Jun 11 12:21:49.393437 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.393170 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 12:21:49.439619 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.439595 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qx46k"] Jun 11 12:21:49.465573 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.465555 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vlp8h"] Jun 11 12:21:49.465694 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.465671 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.470998 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.470978 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 12:21:49.471406 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.471384 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 12:21:49.471660 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.471632 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-54jbl\"" Jun 11 12:21:49.489441 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.489425 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx46k"] Jun 11 12:21:49.489530 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.489460 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlp8h"] Jun 11 12:21:49.489599 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.489556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.493284 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.493256 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 12:21:49.493425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.493364 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 12:21:49.493425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.493384 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 12:21:49.493425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.493400 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dpbzd\"" Jun 11 12:21:49.572149 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.572128 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46516883-21ad-428c-8a85-e00eae76091a-config-volume\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.572236 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.572168 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.572236 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.572187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46516883-21ad-428c-8a85-e00eae76091a-tmp-dir\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.572236 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.572227 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nnnd\" (UniqueName: \"kubernetes.io/projected/46516883-21ad-428c-8a85-e00eae76091a-kube-api-access-5nnnd\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.672935 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.672905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46516883-21ad-428c-8a85-e00eae76091a-config-volume\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.672935 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.672929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.673060 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.672947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/155e8c42-7549-4683-a139-449cfff8da9b-cert\") pod \"ingress-canary-vlp8h\" (UID: \"155e8c42-7549-4683-a139-449cfff8da9b\") " pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.673060 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.672964 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46516883-21ad-428c-8a85-e00eae76091a-tmp-dir\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.673060 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.672989 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nnnd\" (UniqueName: \"kubernetes.io/projected/46516883-21ad-428c-8a85-e00eae76091a-kube-api-access-5nnnd\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.673060 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:49.673030 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:49.673201 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:49.673083 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:50.173068083 +0000 UTC m=+38.626679163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:21:49.673201 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.673101 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2l6\" (UniqueName: \"kubernetes.io/projected/155e8c42-7549-4683-a139-449cfff8da9b-kube-api-access-hx2l6\") pod \"ingress-canary-vlp8h\" (UID: \"155e8c42-7549-4683-a139-449cfff8da9b\") " pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.673282 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.673268 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46516883-21ad-428c-8a85-e00eae76091a-tmp-dir\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.673456 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.673438 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46516883-21ad-428c-8a85-e00eae76091a-config-volume\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.683729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.683711 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nnnd\" (UniqueName: \"kubernetes.io/projected/46516883-21ad-428c-8a85-e00eae76091a-kube-api-access-5nnnd\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:49.773665 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.773645 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/155e8c42-7549-4683-a139-449cfff8da9b-cert\") pod \"ingress-canary-vlp8h\" (UID: \"155e8c42-7549-4683-a139-449cfff8da9b\") " pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.773744 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.773689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2l6\" (UniqueName: \"kubernetes.io/projected/155e8c42-7549-4683-a139-449cfff8da9b-kube-api-access-hx2l6\") pod \"ingress-canary-vlp8h\" (UID: \"155e8c42-7549-4683-a139-449cfff8da9b\") " pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.775819 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.775799 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/155e8c42-7549-4683-a139-449cfff8da9b-cert\") pod \"ingress-canary-vlp8h\" (UID: \"155e8c42-7549-4683-a139-449cfff8da9b\") " pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.782340 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.782320 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2l6\" (UniqueName: \"kubernetes.io/projected/155e8c42-7549-4683-a139-449cfff8da9b-kube-api-access-hx2l6\") pod \"ingress-canary-vlp8h\" (UID: \"155e8c42-7549-4683-a139-449cfff8da9b\") " pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.797154 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.797134 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlp8h" Jun 11 12:21:49.945508 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.945304 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:21:49.945643 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.945304 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:21:49.945643 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.945617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:21:49.949423 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.948783 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:21:49.949423 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.949117 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:21:49.950214 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.950022 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:21:49.950214 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.950161 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v492\"" Jun 11 12:21:49.950214 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.950175 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:21:49.950437 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.950311 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jffg2\"" Jun 11 12:21:49.984046 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:49.984023 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlp8h"] Jun 11 12:21:49.990320 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:21:49.990296 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155e8c42_7549_4683_a139_449cfff8da9b.slice/crio-622da412e8bf657143a6d326be0610652c4dfa339076fe3c72ea47e54f6dec93 WatchSource:0}: Error finding container 622da412e8bf657143a6d326be0610652c4dfa339076fe3c72ea47e54f6dec93: Status 404 returned error can't find the container with id 622da412e8bf657143a6d326be0610652c4dfa339076fe3c72ea47e54f6dec93 Jun 11 12:21:50.119514 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:50.119490 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlp8h" event={"ID":"155e8c42-7549-4683-a139-449cfff8da9b","Type":"ContainerStarted","Data":"622da412e8bf657143a6d326be0610652c4dfa339076fe3c72ea47e54f6dec93"} Jun 11 12:21:50.176123 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:50.176102 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:50.176256 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:50.176241 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:50.176316 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:50.176300 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:51.176281158 +0000 UTC m=+39.629892242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:21:51.181825 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:51.181795 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:51.182363 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:51.181914 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:51.182363 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:51.181966 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:53.181954192 +0000 UTC m=+41.635565268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:21:53.127875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:53.127845 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlp8h" event={"ID":"155e8c42-7549-4683-a139-449cfff8da9b","Type":"ContainerStarted","Data":"ae4c78fc639119cd348b5061bcd26b2ff97d3088e287b003c787038161e5ef10"} Jun 11 12:21:53.149909 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:53.149863 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vlp8h" podStartSLOduration=1.793257973 podStartE2EDuration="4.149848398s" totalImagesPullingTime="2.356590425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:53.148684521 +0000 UTC m=+41.602295618" watchObservedRunningTime="2026-06-11 12:21:53.149848398 +0000 UTC m=+41.603459495" Jun 11 12:21:53.197524 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:53.197495 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:53.197639 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:53.197626 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:53.197684 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:53.197676 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:21:57.197662978 +0000 UTC m=+45.651274053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:21:57.223436 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:21:57.223340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:21:57.223803 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:57.223482 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:57.223803 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:21:57.223557 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:22:05.22352918 +0000 UTC m=+53.677140255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:22:05.272292 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:05.272234 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:22:05.272861 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:05.272388 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:22:05.272861 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:05.272461 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:22:21.272446228 +0000 UTC m=+69.726057304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:22:15.109484 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:15.109452 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5wtw" Jun 11 12:22:17.655784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.655745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:22:17.658874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.658845 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:22:17.666396 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:17.666378 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:22:17.666451 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:17.666438 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:23:21.666424022 +0000 UTC m=+130.120035098 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : secret "metrics-daemon-secret" not found Jun 11 12:22:17.756293 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.756258 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:22:17.759321 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.759299 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:22:17.770287 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.770257 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7f61177-3d0e-49e2-9800-2a9e1c7fac17-original-pull-secret\") pod \"global-pull-secret-syncer-rdt4q\" (UID: \"d7f61177-3d0e-49e2-9800-2a9e1c7fac17\") " pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:22:17.857272 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.857223 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:22:17.860335 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.860316 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:22:17.865510 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.865497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rdt4q" Jun 11 12:22:17.870470 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.870453 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:22:17.879984 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.879961 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qf8j\" (UniqueName: \"kubernetes.io/projected/dc5903d7-5aea-448d-8d49-e751071a463a-kube-api-access-2qf8j\") pod \"network-check-target-qswmv\" (UID: \"dc5903d7-5aea-448d-8d49-e751071a463a\") " pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:22:17.985225 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:17.985193 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rdt4q"] Jun 11 12:22:17.988212 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:22:17.988181 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f61177_3d0e_49e2_9800_2a9e1c7fac17.slice/crio-3af65b6f3c0d5f85f098d8ca55c1ed8a7a3289e6f9fcf328e7dfb37b3b50400f WatchSource:0}: Error finding container 3af65b6f3c0d5f85f098d8ca55c1ed8a7a3289e6f9fcf328e7dfb37b3b50400f: Status 404 returned error can't find the container with id 3af65b6f3c0d5f85f098d8ca55c1ed8a7a3289e6f9fcf328e7dfb37b3b50400f Jun 11 12:22:18.162668 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:18.162583 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jffg2\"" Jun 11 12:22:18.170571 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:18.170554 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:22:18.184863 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:18.184833 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rdt4q" event={"ID":"d7f61177-3d0e-49e2-9800-2a9e1c7fac17","Type":"ContainerStarted","Data":"3af65b6f3c0d5f85f098d8ca55c1ed8a7a3289e6f9fcf328e7dfb37b3b50400f"} Jun 11 12:22:18.299190 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:18.299149 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qswmv"] Jun 11 12:22:18.301785 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:22:18.301762 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5903d7_5aea_448d_8d49_e751071a463a.slice/crio-9b23704df085c44ec6f250e6abf75012b142f7aebacfc3a7c86232131943f2bf WatchSource:0}: Error finding container 9b23704df085c44ec6f250e6abf75012b142f7aebacfc3a7c86232131943f2bf: Status 404 returned error can't find the container with id 9b23704df085c44ec6f250e6abf75012b142f7aebacfc3a7c86232131943f2bf Jun 11 12:22:19.189059 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:19.189013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qswmv" event={"ID":"dc5903d7-5aea-448d-8d49-e751071a463a","Type":"ContainerStarted","Data":"9b23704df085c44ec6f250e6abf75012b142f7aebacfc3a7c86232131943f2bf"} Jun 11 12:22:21.196182 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:21.196139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qswmv" event={"ID":"dc5903d7-5aea-448d-8d49-e751071a463a","Type":"ContainerStarted","Data":"225fe8123dfc2b99f9e875a68f8a61be7bc632df6a1edc56d7d27e542cafa61c"} Jun 11 12:22:21.196661 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:21.196305 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:22:21.213801 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:21.213744 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qswmv" podStartSLOduration=66.446733468 podStartE2EDuration="1m9.213726179s" totalImagesPullingTime="2.766992711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:22:21.21362039 +0000 UTC m=+69.667231490" watchObservedRunningTime="2026-06-11 12:22:21.213726179 +0000 UTC m=+69.667337276" Jun 11 12:22:21.284739 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:21.284699 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:22:21.284903 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:21.284857 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:22:21.284955 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:21.284934 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:22:53.284917668 +0000 UTC m=+101.738528756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:22:23.203242 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:23.203207 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rdt4q" event={"ID":"d7f61177-3d0e-49e2-9800-2a9e1c7fac17","Type":"ContainerStarted","Data":"6289b24757c470566c373c09c70417cbeeb9d376f0d477f4ae6f13f99a9cdbfd"} Jun 11 12:22:23.220339 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:23.220285 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rdt4q" podStartSLOduration=66.40960942 podStartE2EDuration="1m11.220266706s" totalImagesPullingTime="4.810657286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:22:23.219797988 +0000 UTC m=+71.673409076" watchObservedRunningTime="2026-06-11 12:22:23.220266706 +0000 UTC m=+71.673877801" Jun 11 12:22:52.201935 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:52.201832 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qswmv" Jun 11 12:22:53.293528 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:53.293488 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:22:53.293921 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:53.293664 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:22:53.293921 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:22:53.293736 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:23:57.293721087 +0000 UTC m=+165.747332165 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:22:54.106875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.106840 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp"] Jun 11 12:22:54.110975 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.110955 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.113803 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.113779 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 12:22:54.115151 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.115124 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 12:22:54.115151 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.115148 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 12:22:54.115309 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.115178 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 12:22:54.115309 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.115251 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l72fx\"" Jun 11 12:22:54.119629 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.119609 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp"] Jun 11 12:22:54.199684 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.199645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/447b437f-505b-4133-8cd3-c18283d0292c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp\" (UID: \"447b437f-505b-4133-8cd3-c18283d0292c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.199684 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.199689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt642\" (UniqueName: \"kubernetes.io/projected/447b437f-505b-4133-8cd3-c18283d0292c-kube-api-access-lt642\") pod \"managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp\" (UID: \"447b437f-505b-4133-8cd3-c18283d0292c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.300418 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.300380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/447b437f-505b-4133-8cd3-c18283d0292c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp\" (UID: \"447b437f-505b-4133-8cd3-c18283d0292c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.300418 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.300418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt642\" (UniqueName: \"kubernetes.io/projected/447b437f-505b-4133-8cd3-c18283d0292c-kube-api-access-lt642\") pod \"managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp\" (UID: \"447b437f-505b-4133-8cd3-c18283d0292c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.302930 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.302896 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/447b437f-505b-4133-8cd3-c18283d0292c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp\" (UID: \"447b437f-505b-4133-8cd3-c18283d0292c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.309961 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.309936 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt642\" (UniqueName: \"kubernetes.io/projected/447b437f-505b-4133-8cd3-c18283d0292c-kube-api-access-lt642\") pod \"managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp\" (UID: \"447b437f-505b-4133-8cd3-c18283d0292c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.435066 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.435033 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" Jun 11 12:22:54.560490 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:54.560423 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp"] Jun 11 12:22:54.563729 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:22:54.563694 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod447b437f_505b_4133_8cd3_c18283d0292c.slice/crio-4870908c57875ca32e4bf4a523f5545608cba12d6b0a2433d090fcff4ebe5b6b WatchSource:0}: Error finding container 4870908c57875ca32e4bf4a523f5545608cba12d6b0a2433d090fcff4ebe5b6b: Status 404 returned error can't find the container with id 4870908c57875ca32e4bf4a523f5545608cba12d6b0a2433d090fcff4ebe5b6b Jun 11 12:22:55.279660 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:55.279623 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" event={"ID":"447b437f-505b-4133-8cd3-c18283d0292c","Type":"ContainerStarted","Data":"4870908c57875ca32e4bf4a523f5545608cba12d6b0a2433d090fcff4ebe5b6b"} Jun 11 12:22:58.288357 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:58.288316 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" event={"ID":"447b437f-505b-4133-8cd3-c18283d0292c","Type":"ContainerStarted","Data":"954a4359476b65838fa116bd816a5c45d8761427349744440ee20994c326c7dd"} Jun 11 12:22:58.306637 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:22:58.306592 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" podStartSLOduration=1.435923221 podStartE2EDuration="4.306577701s" totalImagesPullingTime="2.87065448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:22:58.305827505 +0000 UTC m=+106.759438611" watchObservedRunningTime="2026-06-11 12:22:58.306577701 +0000 UTC m=+106.760188797" Jun 11 12:23:21.688606 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:23:21.688537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:23:21.689083 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:23:21.688646 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:23:21.689083 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:23:21.688718 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs podName:e357e063-6064-47cf-8dc3-09684c032c6c nodeName:}" failed. No retries permitted until 2026-06-11 12:25:23.688703962 +0000 UTC m=+252.142315038 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs") pod "network-metrics-daemon-fc84k" (UID: "e357e063-6064-47cf-8dc3-09684c032c6c") : secret "metrics-daemon-secret" not found Jun 11 12:23:52.474846 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:23:52.474799 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qx46k" podUID="46516883-21ad-428c-8a85-e00eae76091a" Jun 11 12:23:52.969351 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:23:52.969314 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fc84k" podUID="e357e063-6064-47cf-8dc3-09684c032c6c" Jun 11 12:23:53.413756 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:23:53.413729 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx46k" Jun 11 12:23:57.332066 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:23:57.332021 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:23:57.332447 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:23:57.332171 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:23:57.332447 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:23:57.332284 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls podName:46516883-21ad-428c-8a85-e00eae76091a nodeName:}" failed. No retries permitted until 2026-06-11 12:25:59.332263333 +0000 UTC m=+287.785874424 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls") pod "dns-default-qx46k" (UID: "46516883-21ad-428c-8a85-e00eae76091a") : secret "dns-default-metrics-tls" not found Jun 11 12:24:05.945375 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:05.945288 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:24:13.396637 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.396605 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-w9nrd"] Jun 11 12:24:13.399249 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.399232 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.409456 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.409428 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57fdc95979-z6gzk"] Jun 11 12:24:13.412069 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.412052 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7dcf8c4d4f-g2kcl"] Jun 11 12:24:13.412193 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.412157 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.414662 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.414645 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.432198 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.432178 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 12:24:13.432285 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.432198 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.434402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434385 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d22c5d13-629e-409c-9164-99b1bcee4e74-trusted-ca\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.434455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434409 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-certificates\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-image-registry-private-configuration\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-ca-trust-extracted\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434576 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434464 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmgcq\" (UniqueName: \"kubernetes.io/projected/d22c5d13-629e-409c-9164-99b1bcee4e74-kube-api-access-wmgcq\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.434576 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434521 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-trusted-ca\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434576 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434569 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-stats-auth\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.434681 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434590 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bf47\" (UniqueName: \"kubernetes.io/projected/568bbb4d-94a7-4257-a01a-4c87703a586c-kube-api-access-7bf47\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.434681 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434681 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d22c5d13-629e-409c-9164-99b1bcee4e74-serving-cert\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.434681 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.434812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434681 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.434812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434704 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d22c5d13-629e-409c-9164-99b1bcee4e74-config\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.434812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-bound-sa-token\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434782 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-installation-pull-secrets\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434797 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrqd\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-kube-api-access-pdrqd\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.434974 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.434818 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-default-certificate\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.438914 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.438855 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 12:24:13.438914 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.438867 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 12:24:13.438914 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.438867 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.438914 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.438907 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 12:24:13.439110 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.438907 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 12:24:13.439184 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.439171 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.440080 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440067 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.440402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440370 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 12:24:13.440402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440381 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zcbj2\"" Jun 11 12:24:13.440402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440394 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 12:24:13.440585 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440444 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8sxlv\"" Jun 11 12:24:13.440585 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440376 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksp79\"" Jun 11 12:24:13.440585 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440371 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 12:24:13.440585 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.440487 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 12:24:13.448993 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.448970 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 12:24:13.449481 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.449434 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-w9nrd"] Jun 11 12:24:13.449637 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.449623 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 12:24:13.458940 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.458921 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dcf8c4d4f-g2kcl"] Jun 11 12:24:13.467777 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.467759 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57fdc95979-z6gzk"] Jun 11 12:24:13.535529 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-installation-pull-secrets\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.535757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535532 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrqd\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-kube-api-access-pdrqd\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.535757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535585 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-default-certificate\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.535757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d22c5d13-629e-409c-9164-99b1bcee4e74-trusted-ca\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.535757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535634 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-certificates\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.535757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535662 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-image-registry-private-configuration\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.535757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535683 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-ca-trust-extracted\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535844 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmgcq\" (UniqueName: \"kubernetes.io/projected/d22c5d13-629e-409c-9164-99b1bcee4e74-kube-api-access-wmgcq\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-trusted-ca\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535912 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-stats-auth\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535943 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bf47\" (UniqueName: \"kubernetes.io/projected/568bbb4d-94a7-4257-a01a-4c87703a586c-kube-api-access-7bf47\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535978 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.535997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d22c5d13-629e-409c-9164-99b1bcee4e74-serving-cert\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.536058 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.536021 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.536403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.536090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.536403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.536117 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d22c5d13-629e-409c-9164-99b1bcee4e74-config\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.536403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.536140 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-bound-sa-token\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.536403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.536290 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-certificates\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.536627 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:13.536466 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:24:13.536627 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:13.536486 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fdc95979-z6gzk: secret "image-registry-tls" not found Jun 11 12:24:13.536627 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:13.536579 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls podName:8ecf2cfe-a6c7-4491-85e6-61b22b94ebff nodeName:}" failed. No retries permitted until 2026-06-11 12:24:14.036535804 +0000 UTC m=+182.490146879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls") pod "image-registry-57fdc95979-z6gzk" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff") : secret "image-registry-tls" not found Jun 11 12:24:13.537119 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:13.536880 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:14.0368626 +0000 UTC m=+182.490473695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : configmap references non-existent config key: service-ca.crt Jun 11 12:24:13.537119 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.536053 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-ca-trust-extracted\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.537119 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:13.536941 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:24:13.537119 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:13.537006 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:14.036989089 +0000 UTC m=+182.490600181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : secret "router-metrics-certs-default" not found Jun 11 12:24:13.537803 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.537739 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d22c5d13-629e-409c-9164-99b1bcee4e74-config\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.537983 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.537801 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d22c5d13-629e-409c-9164-99b1bcee4e74-trusted-ca\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.538381 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.538355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-trusted-ca\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.538490 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.538467 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-installation-pull-secrets\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.538580 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.538507 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-image-registry-private-configuration\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.538811 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.538783 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-default-certificate\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.538914 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.538877 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-stats-auth\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.539064 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.539046 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d22c5d13-629e-409c-9164-99b1bcee4e74-serving-cert\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.550724 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.550706 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg"] Jun 11 12:24:13.554569 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.554554 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" Jun 11 12:24:13.568438 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.568420 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.568840 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.568820 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ljljp\"" Jun 11 12:24:13.570355 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.570333 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.570773 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.570748 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmgcq\" (UniqueName: \"kubernetes.io/projected/d22c5d13-629e-409c-9164-99b1bcee4e74-kube-api-access-wmgcq\") pod \"console-operator-668fdbf85c-w9nrd\" (UID: \"d22c5d13-629e-409c-9164-99b1bcee4e74\") " pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.570919 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.570904 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bf47\" (UniqueName: \"kubernetes.io/projected/568bbb4d-94a7-4257-a01a-4c87703a586c-kube-api-access-7bf47\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:13.571281 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.571252 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg"] Jun 11 12:24:13.579525 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.579508 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrqd\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-kube-api-access-pdrqd\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.587778 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.587755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-bound-sa-token\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:13.636973 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.636948 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv8cd\" (UniqueName: \"kubernetes.io/projected/75360e33-18e8-40af-9483-dffbf4abca3c-kube-api-access-mv8cd\") pod \"volume-data-source-validator-78dd696465-dfdpg\" (UID: \"75360e33-18e8-40af-9483-dffbf4abca3c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" Jun 11 12:24:13.710695 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.710674 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:13.737913 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.737878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv8cd\" (UniqueName: \"kubernetes.io/projected/75360e33-18e8-40af-9483-dffbf4abca3c-kube-api-access-mv8cd\") pod \"volume-data-source-validator-78dd696465-dfdpg\" (UID: \"75360e33-18e8-40af-9483-dffbf4abca3c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" Jun 11 12:24:13.746860 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.746836 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv8cd\" (UniqueName: \"kubernetes.io/projected/75360e33-18e8-40af-9483-dffbf4abca3c-kube-api-access-mv8cd\") pod \"volume-data-source-validator-78dd696465-dfdpg\" (UID: \"75360e33-18e8-40af-9483-dffbf4abca3c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" Jun 11 12:24:13.826512 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.826436 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-w9nrd"] Jun 11 12:24:13.828369 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:13.828343 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22c5d13_629e_409c_9164_99b1bcee4e74.slice/crio-b0c48da5e111fd2dd2026d1234379f597bcbbd8b5706d418a6715b6beb9dc95c WatchSource:0}: Error finding container b0c48da5e111fd2dd2026d1234379f597bcbbd8b5706d418a6715b6beb9dc95c: Status 404 returned error can't find the container with id b0c48da5e111fd2dd2026d1234379f597bcbbd8b5706d418a6715b6beb9dc95c Jun 11 12:24:13.862757 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.862733 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" Jun 11 12:24:13.979995 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:13.979924 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg"] Jun 11 12:24:13.982496 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:13.982473 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75360e33_18e8_40af_9483_dffbf4abca3c.slice/crio-ad510b33169a17bcd59a40ac424ac4b9f2a98e099ab7a6cc36c8a8770d313b0b WatchSource:0}: Error finding container ad510b33169a17bcd59a40ac424ac4b9f2a98e099ab7a6cc36c8a8770d313b0b: Status 404 returned error can't find the container with id ad510b33169a17bcd59a40ac424ac4b9f2a98e099ab7a6cc36c8a8770d313b0b Jun 11 12:24:14.040309 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:14.040284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:14.040402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:14.040321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:14.040402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:14.040357 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:14.040509 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:14.040418 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:24:14.040509 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:14.040435 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fdc95979-z6gzk: secret "image-registry-tls" not found Jun 11 12:24:14.040509 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:14.040476 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls podName:8ecf2cfe-a6c7-4491-85e6-61b22b94ebff nodeName:}" failed. No retries permitted until 2026-06-11 12:24:15.040463433 +0000 UTC m=+183.494074509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls") pod "image-registry-57fdc95979-z6gzk" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff") : secret "image-registry-tls" not found Jun 11 12:24:14.040509 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:14.040488 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:24:14.040509 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:14.040505 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:15.040489202 +0000 UTC m=+183.494100297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : configmap references non-existent config key: service-ca.crt Jun 11 12:24:14.040707 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:14.040530 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:15.040518688 +0000 UTC m=+183.494129767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : secret "router-metrics-certs-default" not found Jun 11 12:24:14.463286 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:14.463251 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" event={"ID":"75360e33-18e8-40af-9483-dffbf4abca3c","Type":"ContainerStarted","Data":"ad510b33169a17bcd59a40ac424ac4b9f2a98e099ab7a6cc36c8a8770d313b0b"} Jun 11 12:24:14.464219 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:14.464182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" event={"ID":"d22c5d13-629e-409c-9164-99b1bcee4e74","Type":"ContainerStarted","Data":"b0c48da5e111fd2dd2026d1234379f597bcbbd8b5706d418a6715b6beb9dc95c"} Jun 11 12:24:15.048042 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:15.048003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:15.048233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:15.048049 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:15.048233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:15.048107 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:15.048233 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:15.048116 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:24:15.048233 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:15.048140 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fdc95979-z6gzk: secret "image-registry-tls" not found Jun 11 12:24:15.048233 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:15.048199 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:24:15.048493 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:15.048202 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls podName:8ecf2cfe-a6c7-4491-85e6-61b22b94ebff nodeName:}" failed. No retries permitted until 2026-06-11 12:24:17.048183478 +0000 UTC m=+185.501794570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls") pod "image-registry-57fdc95979-z6gzk" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff") : secret "image-registry-tls" not found Jun 11 12:24:15.048493 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:15.048263 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:17.048248542 +0000 UTC m=+185.501859632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : configmap references non-existent config key: service-ca.crt Jun 11 12:24:15.048493 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:15.048280 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:17.048273923 +0000 UTC m=+185.501885004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : secret "router-metrics-certs-default" not found Jun 11 12:24:15.469095 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:15.469062 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" event={"ID":"75360e33-18e8-40af-9483-dffbf4abca3c","Type":"ContainerStarted","Data":"ff0aecf422930b675c9e2ee937612ad22feb1a3aa2ca1dc635e544ec9ebb1eed"} Jun 11 12:24:15.489736 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:15.489696 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dfdpg" podStartSLOduration=1.1095377260000001 podStartE2EDuration="2.489682767s" totalImagesPullingTime="1.380145041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:15.488263924 +0000 UTC m=+183.941875041" watchObservedRunningTime="2026-06-11 12:24:15.489682767 +0000 UTC m=+183.943293842" Jun 11 12:24:17.063454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.063387 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:17.063454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.063420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:17.063454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.063441 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:17.063872 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:17.063536 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:24:17.063872 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:17.063563 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:24:17.063872 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:17.063584 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fdc95979-z6gzk: secret "image-registry-tls" not found Jun 11 12:24:17.063872 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:17.063591 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:21.063577394 +0000 UTC m=+189.517188469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : configmap references non-existent config key: service-ca.crt Jun 11 12:24:17.063872 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:17.063607 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:21.06359991 +0000 UTC m=+189.517210985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : secret "router-metrics-certs-default" not found Jun 11 12:24:17.063872 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:17.063629 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls podName:8ecf2cfe-a6c7-4491-85e6-61b22b94ebff nodeName:}" failed. No retries permitted until 2026-06-11 12:24:21.06361343 +0000 UTC m=+189.517224520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls") pod "image-registry-57fdc95979-z6gzk" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff") : secret "image-registry-tls" not found Jun 11 12:24:17.477290 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.477268 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/0.log" Jun 11 12:24:17.477409 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.477306 2569 generic.go:356] "Generic (PLEG): container finished" podID="d22c5d13-629e-409c-9164-99b1bcee4e74" containerID="c8e1fea5614c27696328f7c7322465ae01e5d53c42e406bf4517a1f007cda6b0" exitCode=255 Jun 11 12:24:17.477409 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.477334 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" event={"ID":"d22c5d13-629e-409c-9164-99b1bcee4e74","Type":"ContainerDied","Data":"c8e1fea5614c27696328f7c7322465ae01e5d53c42e406bf4517a1f007cda6b0"} Jun 11 12:24:17.477555 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:17.477528 2569 scope.go:117] "RemoveContainer" containerID="c8e1fea5614c27696328f7c7322465ae01e5d53c42e406bf4517a1f007cda6b0" Jun 11 12:24:18.014834 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.014806 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf"] Jun 11 12:24:18.017731 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.017715 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" Jun 11 12:24:18.024564 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.024527 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 12:24:18.024564 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.024556 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 12:24:18.025910 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.025895 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-96dz5\"" Jun 11 12:24:18.033195 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.033177 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf"] Jun 11 12:24:18.069362 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.069339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmzsd\" (UniqueName: \"kubernetes.io/projected/537c1007-40db-4bd4-9f24-25e9e010a539-kube-api-access-mmzsd\") pod \"migrator-955ffdf5f-cw7nf\" (UID: \"537c1007-40db-4bd4-9f24-25e9e010a539\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" Jun 11 12:24:18.170162 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.170138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmzsd\" (UniqueName: \"kubernetes.io/projected/537c1007-40db-4bd4-9f24-25e9e010a539-kube-api-access-mmzsd\") pod \"migrator-955ffdf5f-cw7nf\" (UID: \"537c1007-40db-4bd4-9f24-25e9e010a539\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" Jun 11 12:24:18.193032 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.193012 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmzsd\" (UniqueName: \"kubernetes.io/projected/537c1007-40db-4bd4-9f24-25e9e010a539-kube-api-access-mmzsd\") pod \"migrator-955ffdf5f-cw7nf\" (UID: \"537c1007-40db-4bd4-9f24-25e9e010a539\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" Jun 11 12:24:18.325773 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.325700 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" Jun 11 12:24:18.453785 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.453756 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf"] Jun 11 12:24:18.456306 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:18.456284 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537c1007_40db_4bd4_9f24_25e9e010a539.slice/crio-10eca7a266b8de7c35938709ffee12e091562c69313f17c956debd29650fca5c WatchSource:0}: Error finding container 10eca7a266b8de7c35938709ffee12e091562c69313f17c956debd29650fca5c: Status 404 returned error can't find the container with id 10eca7a266b8de7c35938709ffee12e091562c69313f17c956debd29650fca5c Jun 11 12:24:18.481928 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.481912 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:24:18.482285 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.482268 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/0.log" Jun 11 12:24:18.482372 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.482307 2569 generic.go:356] "Generic (PLEG): container finished" podID="d22c5d13-629e-409c-9164-99b1bcee4e74" containerID="f05b6f41c0d9ccd3a4ab0375df021eb7ccb10a752537b6c1e71e12f22880a1ef" exitCode=255 Jun 11 12:24:18.482426 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.482393 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" event={"ID":"d22c5d13-629e-409c-9164-99b1bcee4e74","Type":"ContainerDied","Data":"f05b6f41c0d9ccd3a4ab0375df021eb7ccb10a752537b6c1e71e12f22880a1ef"} Jun 11 12:24:18.482468 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.482458 2569 scope.go:117] "RemoveContainer" containerID="c8e1fea5614c27696328f7c7322465ae01e5d53c42e406bf4517a1f007cda6b0" Jun 11 12:24:18.482600 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.482585 2569 scope.go:117] "RemoveContainer" containerID="f05b6f41c0d9ccd3a4ab0375df021eb7ccb10a752537b6c1e71e12f22880a1ef" Jun 11 12:24:18.482794 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:18.482763 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-w9nrd_openshift-console-operator(d22c5d13-629e-409c-9164-99b1bcee4e74)\"" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" podUID="d22c5d13-629e-409c-9164-99b1bcee4e74" Jun 11 12:24:18.483595 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:18.483576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" event={"ID":"537c1007-40db-4bd4-9f24-25e9e010a539","Type":"ContainerStarted","Data":"10eca7a266b8de7c35938709ffee12e091562c69313f17c956debd29650fca5c"} Jun 11 12:24:19.487762 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:19.487743 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:24:19.488124 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:19.488102 2569 scope.go:117] "RemoveContainer" containerID="f05b6f41c0d9ccd3a4ab0375df021eb7ccb10a752537b6c1e71e12f22880a1ef" Jun 11 12:24:19.488272 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:19.488252 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-w9nrd_openshift-console-operator(d22c5d13-629e-409c-9164-99b1bcee4e74)\"" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" podUID="d22c5d13-629e-409c-9164-99b1bcee4e74" Jun 11 12:24:20.492461 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:20.492425 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" event={"ID":"537c1007-40db-4bd4-9f24-25e9e010a539","Type":"ContainerStarted","Data":"b02f83975637ff3b9520981468053816f0125bcd44da4d96546231bcbf3955ef"} Jun 11 12:24:20.492821 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:20.492485 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" event={"ID":"537c1007-40db-4bd4-9f24-25e9e010a539","Type":"ContainerStarted","Data":"63f058a156639974b80c3d2abc2bc8ce313a3a72f10ea2f71eb46ad7e94c59e3"} Jun 11 12:24:20.515091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:20.515051 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-cw7nf" podStartSLOduration=2.498067469 podStartE2EDuration="3.515037198s" totalImagesPullingTime="1.016969729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:20.513472595 +0000 UTC m=+188.967083691" watchObservedRunningTime="2026-06-11 12:24:20.515037198 +0000 UTC m=+188.968648292" Jun 11 12:24:21.090039 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:21.090003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:21.090185 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:21.090051 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:21.090185 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:21.090068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:21.090185 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:21.090145 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:24:21.090185 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:21.090175 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:29.090158656 +0000 UTC m=+197.543769739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : configmap references non-existent config key: service-ca.crt Jun 11 12:24:21.090185 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:21.090150 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:24:21.090338 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:21.090190 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:29.090184047 +0000 UTC m=+197.543795122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : secret "router-metrics-certs-default" not found Jun 11 12:24:21.090338 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:21.090190 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fdc95979-z6gzk: secret "image-registry-tls" not found Jun 11 12:24:21.090338 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:21.090220 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls podName:8ecf2cfe-a6c7-4491-85e6-61b22b94ebff nodeName:}" failed. No retries permitted until 2026-06-11 12:24:29.090208304 +0000 UTC m=+197.543819379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls") pod "image-registry-57fdc95979-z6gzk" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff") : secret "image-registry-tls" not found Jun 11 12:24:21.267338 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:21.267316 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xj49p_916fca5e-e135-4925-bf87-5ba50b1e3925/dns-node-resolver/0.log" Jun 11 12:24:22.068925 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:22.068899 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ck4gh_f88c2ec3-858c-4985-88a4-a7521051c799/node-ca/0.log" Jun 11 12:24:23.059797 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:23.059772 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlp8h_155e8c42-7549-4683-a139-449cfff8da9b/serve-healthcheck-canary/0.log" Jun 11 12:24:23.267212 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:23.267188 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-cw7nf_537c1007-40db-4bd4-9f24-25e9e010a539/migrator/0.log" Jun 11 12:24:23.466835 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:23.466810 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-cw7nf_537c1007-40db-4bd4-9f24-25e9e010a539/graceful-termination/0.log" Jun 11 12:24:23.711444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:23.711419 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:23.711587 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:23.711484 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:23.711808 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:23.711795 2569 scope.go:117] "RemoveContainer" containerID="f05b6f41c0d9ccd3a4ab0375df021eb7ccb10a752537b6c1e71e12f22880a1ef" Jun 11 12:24:23.711936 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:23.711918 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-w9nrd_openshift-console-operator(d22c5d13-629e-409c-9164-99b1bcee4e74)\"" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" podUID="d22c5d13-629e-409c-9164-99b1bcee4e74" Jun 11 12:24:29.153220 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.153186 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:29.153625 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.153249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:29.153625 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.153275 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:29.153625 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:24:29.153352 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle podName:568bbb4d-94a7-4257-a01a-4c87703a586c nodeName:}" failed. No retries permitted until 2026-06-11 12:24:45.153334387 +0000 UTC m=+213.606945466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle") pod "router-default-7dcf8c4d4f-g2kcl" (UID: "568bbb4d-94a7-4257-a01a-4c87703a586c") : configmap references non-existent config key: service-ca.crt Jun 11 12:24:29.155622 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.155600 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"image-registry-57fdc95979-z6gzk\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:29.155622 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.155617 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/568bbb4d-94a7-4257-a01a-4c87703a586c-metrics-certs\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:29.320184 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.320154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:29.442677 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.442606 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57fdc95979-z6gzk"] Jun 11 12:24:29.445340 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:29.445301 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecf2cfe_a6c7_4491_85e6_61b22b94ebff.slice/crio-c67cc867aed42e512541865a3188b560a92ec161dbdf52968da3cc96fc7546a5 WatchSource:0}: Error finding container c67cc867aed42e512541865a3188b560a92ec161dbdf52968da3cc96fc7546a5: Status 404 returned error can't find the container with id c67cc867aed42e512541865a3188b560a92ec161dbdf52968da3cc96fc7546a5 Jun 11 12:24:29.518795 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.518768 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" event={"ID":"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff","Type":"ContainerStarted","Data":"74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764"} Jun 11 12:24:29.518898 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.518813 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" event={"ID":"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff","Type":"ContainerStarted","Data":"c67cc867aed42e512541865a3188b560a92ec161dbdf52968da3cc96fc7546a5"} Jun 11 12:24:29.518898 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.518887 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:24:29.543215 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:29.543167 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podStartSLOduration=16.543150616 podStartE2EDuration="16.543150616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:29.542381495 +0000 UTC m=+197.995992592" watchObservedRunningTime="2026-06-11 12:24:29.543150616 +0000 UTC m=+197.996761714" Jun 11 12:24:38.945877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:38.945848 2569 scope.go:117] "RemoveContainer" containerID="f05b6f41c0d9ccd3a4ab0375df021eb7ccb10a752537b6c1e71e12f22880a1ef" Jun 11 12:24:39.551695 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:39.551672 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:24:39.551853 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:39.551734 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" event={"ID":"d22c5d13-629e-409c-9164-99b1bcee4e74","Type":"ContainerStarted","Data":"887ddd5875f888c06f4f1d023b863dd453e9de0bbcc4c9b06650abd1d49d43e9"} Jun 11 12:24:39.552011 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:39.551992 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:39.556393 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:39.556369 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" Jun 11 12:24:39.575907 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:39.575867 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-w9nrd" podStartSLOduration=23.755001589 podStartE2EDuration="26.575856061s" totalImagesPullingTime="2.820854472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:39.574230641 +0000 UTC m=+208.027841738" watchObservedRunningTime="2026-06-11 12:24:39.575856061 +0000 UTC m=+208.029467158" Jun 11 12:24:45.161609 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.161578 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:45.162119 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.162098 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bbb4d-94a7-4257-a01a-4c87703a586c-service-ca-bundle\") pod \"router-default-7dcf8c4d4f-g2kcl\" (UID: \"568bbb4d-94a7-4257-a01a-4c87703a586c\") " pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:45.224682 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.224641 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:45.359393 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.359309 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dcf8c4d4f-g2kcl"] Jun 11 12:24:45.362026 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:45.361998 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568bbb4d_94a7_4257_a01a_4c87703a586c.slice/crio-8b423599702ac5c83f4f9c6eb3f1404b6106d70c67d812eaa11b10df81de2c5e WatchSource:0}: Error finding container 8b423599702ac5c83f4f9c6eb3f1404b6106d70c67d812eaa11b10df81de2c5e: Status 404 returned error can't find the container with id 8b423599702ac5c83f4f9c6eb3f1404b6106d70c67d812eaa11b10df81de2c5e Jun 11 12:24:45.570276 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.570235 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" event={"ID":"568bbb4d-94a7-4257-a01a-4c87703a586c","Type":"ContainerStarted","Data":"42f7148a13feb0dd41b7d579d144738461e6736f105fee83ef211aab4e388530"} Jun 11 12:24:45.570480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.570301 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" event={"ID":"568bbb4d-94a7-4257-a01a-4c87703a586c","Type":"ContainerStarted","Data":"8b423599702ac5c83f4f9c6eb3f1404b6106d70c67d812eaa11b10df81de2c5e"} Jun 11 12:24:45.596224 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:45.596163 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" podStartSLOduration=32.596142818 podStartE2EDuration="32.596142818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:45.59537942 +0000 UTC m=+214.048990517" watchObservedRunningTime="2026-06-11 12:24:45.596142818 +0000 UTC m=+214.049753915" Jun 11 12:24:46.225600 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:46.225568 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:46.227961 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:46.227942 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:46.573205 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:46.573138 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:46.574288 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:46.574270 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7dcf8c4d4f-g2kcl" Jun 11 12:24:49.325729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:49.325695 2569 patch_prober.go:28] interesting pod/image-registry-57fdc95979-z6gzk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:24:49.326101 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:49.325748 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:24:50.525729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:50.525696 2569 patch_prober.go:28] interesting pod/image-registry-57fdc95979-z6gzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:24:50.526082 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:50.525748 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:24:57.605608 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:57.605580 2569 generic.go:356] "Generic (PLEG): container finished" podID="447b437f-505b-4133-8cd3-c18283d0292c" containerID="954a4359476b65838fa116bd816a5c45d8761427349744440ee20994c326c7dd" exitCode=255 Jun 11 12:24:57.605889 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:57.605656 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" event={"ID":"447b437f-505b-4133-8cd3-c18283d0292c","Type":"ContainerDied","Data":"954a4359476b65838fa116bd816a5c45d8761427349744440ee20994c326c7dd"} Jun 11 12:24:57.605966 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:57.605951 2569 scope.go:117] "RemoveContainer" containerID="954a4359476b65838fa116bd816a5c45d8761427349744440ee20994c326c7dd" Jun 11 12:24:58.271735 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.271706 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-vs7mj"] Jun 11 12:24:58.274683 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.274657 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:24:58.292253 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.292228 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7vmsz\"" Jun 11 12:24:58.305710 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.305691 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 12:24:58.306524 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.306504 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 12:24:58.319877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.319856 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vs7mj"] Jun 11 12:24:58.330369 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.330349 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57fdc95979-z6gzk"] Jun 11 12:24:58.335360 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.335335 2569 patch_prober.go:28] interesting pod/image-registry-57fdc95979-z6gzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:24:58.335460 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.335394 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:24:58.351970 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.351948 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75vm\" (UniqueName: \"kubernetes.io/projected/2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8-kube-api-access-k75vm\") pod \"downloads-6657875f97-vs7mj\" (UID: \"2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8\") " pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:24:58.452791 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.452762 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k75vm\" (UniqueName: \"kubernetes.io/projected/2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8-kube-api-access-k75vm\") pod \"downloads-6657875f97-vs7mj\" (UID: \"2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8\") " pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:24:58.460941 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.460915 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q7spq"] Jun 11 12:24:58.463959 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.463944 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.466729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.466706 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 12:24:58.466729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.466713 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 12:24:58.467088 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.467058 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 12:24:58.467163 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.467150 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cg8m\"" Jun 11 12:24:58.467568 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.467533 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 12:24:58.495051 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.495031 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75vm\" (UniqueName: \"kubernetes.io/projected/2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8-kube-api-access-k75vm\") pod \"downloads-6657875f97-vs7mj\" (UID: \"2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8\") " pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:24:58.501482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.501462 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7spq"] Jun 11 12:24:58.553086 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.553036 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fa7946e-1e94-47e2-bce5-0c4534190b9c-crio-socket\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.553086 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.553079 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fa7946e-1e94-47e2-bce5-0c4534190b9c-data-volume\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.553229 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.553115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbq4c\" (UniqueName: \"kubernetes.io/projected/0fa7946e-1e94-47e2-bce5-0c4534190b9c-kube-api-access-cbq4c\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.553229 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.553176 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa7946e-1e94-47e2-bce5-0c4534190b9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.553229 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.553219 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa7946e-1e94-47e2-bce5-0c4534190b9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.583077 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.583054 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:24:58.610035 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.610013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4f6c4b56-6k5kp" event={"ID":"447b437f-505b-4133-8cd3-c18283d0292c","Type":"ContainerStarted","Data":"70f14466fa6fff27deab1b648f9be4348482c5a080c6a805cc941d29a10f6527"} Jun 11 12:24:58.654460 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654428 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fa7946e-1e94-47e2-bce5-0c4534190b9c-crio-socket\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.654618 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fa7946e-1e94-47e2-bce5-0c4534190b9c-data-volume\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.654618 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654510 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fa7946e-1e94-47e2-bce5-0c4534190b9c-crio-socket\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.654618 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbq4c\" (UniqueName: \"kubernetes.io/projected/0fa7946e-1e94-47e2-bce5-0c4534190b9c-kube-api-access-cbq4c\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.654618 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa7946e-1e94-47e2-bce5-0c4534190b9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.654618 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa7946e-1e94-47e2-bce5-0c4534190b9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.654937 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.654913 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fa7946e-1e94-47e2-bce5-0c4534190b9c-data-volume\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.655222 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.655200 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa7946e-1e94-47e2-bce5-0c4534190b9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.656875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.656854 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa7946e-1e94-47e2-bce5-0c4534190b9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.668395 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.668373 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbq4c\" (UniqueName: \"kubernetes.io/projected/0fa7946e-1e94-47e2-bce5-0c4534190b9c-kube-api-access-cbq4c\") pod \"insights-runtime-extractor-q7spq\" (UID: \"0fa7946e-1e94-47e2-bce5-0c4534190b9c\") " pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.713201 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.713056 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vs7mj"] Jun 11 12:24:58.715261 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:58.715235 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8ea4f0_2e8b_4d00_9657_38bae23b0dc8.slice/crio-f58851f1746fcf537e283d21a7f034448618d91f0dd6e4648c15a841d6a86a4e WatchSource:0}: Error finding container f58851f1746fcf537e283d21a7f034448618d91f0dd6e4648c15a841d6a86a4e: Status 404 returned error can't find the container with id f58851f1746fcf537e283d21a7f034448618d91f0dd6e4648c15a841d6a86a4e Jun 11 12:24:58.772647 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.772629 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7spq" Jun 11 12:24:58.895532 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:58.895380 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7spq"] Jun 11 12:24:58.897816 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:24:58.897794 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa7946e_1e94_47e2_bce5_0c4534190b9c.slice/crio-80379ba65ff9325b9aa004d8cc84a01b9c4e3ccbef6ab2999b19d5bfe3bbf517 WatchSource:0}: Error finding container 80379ba65ff9325b9aa004d8cc84a01b9c4e3ccbef6ab2999b19d5bfe3bbf517: Status 404 returned error can't find the container with id 80379ba65ff9325b9aa004d8cc84a01b9c4e3ccbef6ab2999b19d5bfe3bbf517 Jun 11 12:24:59.617841 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:59.617806 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7spq" event={"ID":"0fa7946e-1e94-47e2-bce5-0c4534190b9c","Type":"ContainerStarted","Data":"ba82008ea3c8ffe8226c0dfbdd378f3b90d6a9cc29fc495531f6c760ef470bcb"} Jun 11 12:24:59.618217 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:59.617910 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7spq" event={"ID":"0fa7946e-1e94-47e2-bce5-0c4534190b9c","Type":"ContainerStarted","Data":"80379ba65ff9325b9aa004d8cc84a01b9c4e3ccbef6ab2999b19d5bfe3bbf517"} Jun 11 12:24:59.619221 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:24:59.619191 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vs7mj" event={"ID":"2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8","Type":"ContainerStarted","Data":"f58851f1746fcf537e283d21a7f034448618d91f0dd6e4648c15a841d6a86a4e"} Jun 11 12:25:00.624235 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:00.624199 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7spq" event={"ID":"0fa7946e-1e94-47e2-bce5-0c4534190b9c","Type":"ContainerStarted","Data":"35f868e389ebdc644e5a42674e7b9de7cea5e252f59e13980d1847b25cc8f2e1"} Jun 11 12:25:01.629935 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:01.629898 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7spq" event={"ID":"0fa7946e-1e94-47e2-bce5-0c4534190b9c","Type":"ContainerStarted","Data":"b9f53a97bfe64914963e208496ecc15413fdd15c56d05a271e2ca74f08724e8e"} Jun 11 12:25:01.658800 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:01.658750 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q7spq" podStartSLOduration=1.606104678 podStartE2EDuration="3.658736126s" totalImagesPullingTime="2.052631448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:24:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:01.656825608 +0000 UTC m=+230.110436727" watchObservedRunningTime="2026-06-11 12:25:01.658736126 +0000 UTC m=+230.112347222" Jun 11 12:25:05.765583 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.765553 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s"] Jun 11 12:25:05.768672 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.768657 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:05.772424 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.772405 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 12:25:05.772701 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.772678 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 12:25:05.772805 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.772724 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wvn7g\"" Jun 11 12:25:05.772805 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.772736 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 12:25:05.773860 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.773839 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 12:25:05.773959 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.773876 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 12:25:05.779133 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.779113 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s"] Jun 11 12:25:05.783510 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.783491 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8"] Jun 11 12:25:05.786382 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.786364 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:05.788565 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.788534 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vm98p"] Jun 11 12:25:05.791468 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.791450 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.793173 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.793157 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-572xt\"" Jun 11 12:25:05.794277 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.794250 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 12:25:05.794383 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.794341 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 12:25:05.794634 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.794618 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 12:25:05.794928 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.794914 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8nktv\"" Jun 11 12:25:05.795021 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.795005 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 12:25:05.796181 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.796166 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 12:25:05.799512 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.799495 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 12:25:05.815139 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.815080 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8"] Jun 11 12:25:05.907902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.907878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a6fe3e8-46c4-42b0-be71-38a177a60f00-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:05.907902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.907905 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lgt7\" (UniqueName: \"kubernetes.io/projected/1a6fe3e8-46c4-42b0-be71-38a177a60f00-kube-api-access-6lgt7\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:05.908076 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.907928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-textfile\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908076 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.907958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:05.908076 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908060 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:05.908206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-sys\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908105 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb98h\" (UniqueName: \"kubernetes.io/projected/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-api-access-hb98h\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:05.908206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908127 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6zt\" (UniqueName: \"kubernetes.io/projected/5a34a99f-3c54-4adf-9c10-bb2692340d3b-kube-api-access-tw6zt\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-tls\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908257 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908277 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908293 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-root\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-wtmp\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908370 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c8e1e3e1-678a-4536-9383-a6faede09b50-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908407 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e1e3e1-678a-4536-9383-a6faede09b50-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:05.908449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a34a99f-3c54-4adf-9c10-bb2692340d3b-metrics-client-ca\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:05.908745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:05.908466 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.008885 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.008859 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c8e1e3e1-678a-4536-9383-a6faede09b50-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.009015 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.008898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e1e3e1-678a-4536-9383-a6faede09b50-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.009015 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.008915 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a34a99f-3c54-4adf-9c10-bb2692340d3b-metrics-client-ca\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009015 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.008933 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.009015 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.008953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a6fe3e8-46c4-42b0-be71-38a177a60f00-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.009223 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009062 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lgt7\" (UniqueName: \"kubernetes.io/projected/1a6fe3e8-46c4-42b0-be71-38a177a60f00-kube-api-access-6lgt7\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.009223 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009110 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-textfile\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009223 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009149 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.009223 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009184 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009224 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-sys\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009262 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb98h\" (UniqueName: \"kubernetes.io/projected/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-api-access-hb98h\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:25:06.009285 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009288 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6zt\" (UniqueName: \"kubernetes.io/projected/5a34a99f-3c54-4adf-9c10-bb2692340d3b-kube-api-access-tw6zt\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009421 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009404 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-tls\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009450 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.009745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.009745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009509 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-root\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009563 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-wtmp\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.009745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009693 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a6fe3e8-46c4-42b0-be71-38a177a60f00-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.009745 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009714 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-wtmp\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009760 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-root\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009758 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e1e3e1-678a-4536-9383-a6faede09b50-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009790 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-textfile\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:25:06.009859 2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:25:06.009918 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-tls podName:c8e1e3e1-678a-4536-9383-a6faede09b50 nodeName:}" failed. No retries permitted until 2026-06-11 12:25:06.509901631 +0000 UTC m=+234.963512706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-7pwl8" (UID: "c8e1e3e1-678a-4536-9383-a6faede09b50") : secret "kube-state-metrics-tls" not found Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a34a99f-3c54-4adf-9c10-bb2692340d3b-sys\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.009988 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.010063 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:25:06.010037 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-tls podName:1a6fe3e8-46c4-42b0-be71-38a177a60f00 nodeName:}" failed. No retries permitted until 2026-06-11 12:25:06.510020315 +0000 UTC m=+234.963631407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-nbr5s" (UID: "1a6fe3e8-46c4-42b0-be71-38a177a60f00") : secret "openshift-state-metrics-tls" not found Jun 11 12:25:06.010456 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.010303 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a34a99f-3c54-4adf-9c10-bb2692340d3b-metrics-client-ca\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.010456 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.010316 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.010456 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.010326 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c8e1e3e1-678a-4536-9383-a6faede09b50-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.012003 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.011981 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-tls\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.012003 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.011994 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.012121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.012046 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.012121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.012092 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a34a99f-3c54-4adf-9c10-bb2692340d3b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.021420 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.021373 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb98h\" (UniqueName: \"kubernetes.io/projected/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-api-access-hb98h\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.023395 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.023368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6zt\" (UniqueName: \"kubernetes.io/projected/5a34a99f-3c54-4adf-9c10-bb2692340d3b-kube-api-access-tw6zt\") pod \"node-exporter-vm98p\" (UID: \"5a34a99f-3c54-4adf-9c10-bb2692340d3b\") " pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.023679 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.023663 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lgt7\" (UniqueName: \"kubernetes.io/projected/1a6fe3e8-46c4-42b0-be71-38a177a60f00-kube-api-access-6lgt7\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.100832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.100810 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vm98p" Jun 11 12:25:06.112940 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:25:06.112897 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a34a99f_3c54_4adf_9c10_bb2692340d3b.slice/crio-d21d14f707409030fa6940080b363297b28397bc50430ef4cf3549dfa3d774e3 WatchSource:0}: Error finding container d21d14f707409030fa6940080b363297b28397bc50430ef4cf3549dfa3d774e3: Status 404 returned error can't find the container with id d21d14f707409030fa6940080b363297b28397bc50430ef4cf3549dfa3d774e3 Jun 11 12:25:06.514291 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.514250 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.514462 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.514343 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.517055 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.516981 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a6fe3e8-46c4-42b0-be71-38a177a60f00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nbr5s\" (UID: \"1a6fe3e8-46c4-42b0-be71-38a177a60f00\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.517262 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.517225 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e1e3e1-678a-4536-9383-a6faede09b50-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7pwl8\" (UID: \"c8e1e3e1-678a-4536-9383-a6faede09b50\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.649121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.649084 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm98p" event={"ID":"5a34a99f-3c54-4adf-9c10-bb2692340d3b","Type":"ContainerStarted","Data":"d21d14f707409030fa6940080b363297b28397bc50430ef4cf3549dfa3d774e3"} Jun 11 12:25:06.677490 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.677433 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" Jun 11 12:25:06.695557 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.695375 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" Jun 11 12:25:06.839434 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.839399 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s"] Jun 11 12:25:06.855298 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:06.855242 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8"] Jun 11 12:25:07.049427 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:25:07.049353 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6fe3e8_46c4_42b0_be71_38a177a60f00.slice/crio-fc86ff32307b70ee903dc353b55eed1bb19c0afd0141228302a9a4de3db9ede3 WatchSource:0}: Error finding container fc86ff32307b70ee903dc353b55eed1bb19c0afd0141228302a9a4de3db9ede3: Status 404 returned error can't find the container with id fc86ff32307b70ee903dc353b55eed1bb19c0afd0141228302a9a4de3db9ede3 Jun 11 12:25:07.050100 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:25:07.050060 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e1e3e1_678a_4536_9383_a6faede09b50.slice/crio-d72468707fafa53617df446b8ae9cfa729f9dab46760b85573babe45ab7a15be WatchSource:0}: Error finding container d72468707fafa53617df446b8ae9cfa729f9dab46760b85573babe45ab7a15be: Status 404 returned error can't find the container with id d72468707fafa53617df446b8ae9cfa729f9dab46760b85573babe45ab7a15be Jun 11 12:25:07.654336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:07.654293 2569 generic.go:356] "Generic (PLEG): container finished" podID="5a34a99f-3c54-4adf-9c10-bb2692340d3b" containerID="356ec282fde247f4528d9440f8eb1a52f73dfe46ceac8a5181b41de90d870978" exitCode=0 Jun 11 12:25:07.654492 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:07.654386 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm98p" event={"ID":"5a34a99f-3c54-4adf-9c10-bb2692340d3b","Type":"ContainerDied","Data":"356ec282fde247f4528d9440f8eb1a52f73dfe46ceac8a5181b41de90d870978"} Jun 11 12:25:07.655748 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:07.655721 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" event={"ID":"c8e1e3e1-678a-4536-9383-a6faede09b50","Type":"ContainerStarted","Data":"d72468707fafa53617df446b8ae9cfa729f9dab46760b85573babe45ab7a15be"} Jun 11 12:25:07.657584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:07.657561 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" event={"ID":"1a6fe3e8-46c4-42b0-be71-38a177a60f00","Type":"ContainerStarted","Data":"7d5b12cf86b3887ac6ab0c1771b2414013295e88b6d28b147a9220502bbdaf0d"} Jun 11 12:25:07.657672 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:07.657610 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" event={"ID":"1a6fe3e8-46c4-42b0-be71-38a177a60f00","Type":"ContainerStarted","Data":"11d50d2d0bd721aa1986fb9e9b27f11809218c85b20e7abd13cd17325c8c0fd9"} Jun 11 12:25:07.657672 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:07.657639 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" event={"ID":"1a6fe3e8-46c4-42b0-be71-38a177a60f00","Type":"ContainerStarted","Data":"fc86ff32307b70ee903dc353b55eed1bb19c0afd0141228302a9a4de3db9ede3"} Jun 11 12:25:08.335744 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.335712 2569 patch_prober.go:28] interesting pod/image-registry-57fdc95979-z6gzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:25:08.336115 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.335764 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:25:08.663769 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.663726 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" event={"ID":"1a6fe3e8-46c4-42b0-be71-38a177a60f00","Type":"ContainerStarted","Data":"d9d43479bef6cb0c3b35cadd29a34e9c44c78da35e6aba1c3bf3d05cc7b5d5a8"} Jun 11 12:25:08.666112 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.666079 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm98p" event={"ID":"5a34a99f-3c54-4adf-9c10-bb2692340d3b","Type":"ContainerStarted","Data":"22066787a046991fc3844a14a4042e71c08df05e77a1b4a9e9d52a6fa61180be"} Jun 11 12:25:08.666238 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.666132 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm98p" event={"ID":"5a34a99f-3c54-4adf-9c10-bb2692340d3b","Type":"ContainerStarted","Data":"223a746ac9505cbc989f4b8a0a31bbededefb196b4fbcd7ee6924bfcc16e06b2"} Jun 11 12:25:08.683738 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.683658 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nbr5s" podStartSLOduration=2.56870908 podStartE2EDuration="3.683640507s" totalImagesPullingTime="1.114931427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:08.681997424 +0000 UTC m=+237.135608521" watchObservedRunningTime="2026-06-11 12:25:08.683640507 +0000 UTC m=+237.137251604" Jun 11 12:25:08.700327 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:08.700137 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vm98p" podStartSLOduration=2.649074378 podStartE2EDuration="3.700120023s" totalImagesPullingTime="979.969591ms" totalInitContainerRuntime="71.076054ms" isStatefulPod=true podCreationTimestamp="2026-06-11 12:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:08.699745853 +0000 UTC m=+237.153356953" watchObservedRunningTime="2026-06-11 12:25:08.700120023 +0000 UTC m=+237.153731106" Jun 11 12:25:09.673617 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:09.673579 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" event={"ID":"c8e1e3e1-678a-4536-9383-a6faede09b50","Type":"ContainerStarted","Data":"4ae7c771faba19d81508b3ab702684df7055135765371827ab5bc0ae43fa6736"} Jun 11 12:25:09.674040 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:09.673645 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" event={"ID":"c8e1e3e1-678a-4536-9383-a6faede09b50","Type":"ContainerStarted","Data":"9f82295f2653ea10dbfa91ffc0a9ae6c599f69e57127f3bf845152161ad78566"} Jun 11 12:25:09.674040 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:09.673674 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" event={"ID":"c8e1e3e1-678a-4536-9383-a6faede09b50","Type":"ContainerStarted","Data":"cd51f66b3aed27546ef57e869157c1a26c7dd1d464a318be77fa72fc9c770888"} Jun 11 12:25:09.696013 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:09.695963 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7pwl8" podStartSLOduration=2.91091405 podStartE2EDuration="4.695944701s" totalImagesPullingTime="1.785030651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:09.694603866 +0000 UTC m=+238.148214961" watchObservedRunningTime="2026-06-11 12:25:09.695944701 +0000 UTC m=+238.149555801" Jun 11 12:25:10.443560 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.443506 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4886-b8jxz"] Jun 11 12:25:10.447599 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.447578 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.450795 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.450754 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 12:25:10.450795 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.450771 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 12:25:10.450959 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.450818 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 12:25:10.450959 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.450822 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 12:25:10.452582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.452428 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9glsz\"" Jun 11 12:25:10.452582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.452449 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 12:25:10.458031 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.458008 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 12:25:10.459665 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.459640 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4886-b8jxz"] Jun 11 12:25:10.550047 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550008 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-serving-cert\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.550207 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gkd\" (UniqueName: \"kubernetes.io/projected/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-kube-api-access-c9gkd\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.550207 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-oauth-serving-cert\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.550207 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-trusted-ca-bundle\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.550340 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-oauth-config\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.550340 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550265 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-service-ca\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.550340 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.550316 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-config\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651407 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651370 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gkd\" (UniqueName: \"kubernetes.io/projected/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-kube-api-access-c9gkd\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-oauth-serving-cert\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-trusted-ca-bundle\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651503 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-oauth-config\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651529 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-service-ca\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651826 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651591 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-config\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.651826 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.651655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-serving-cert\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.652454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.652273 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-oauth-serving-cert\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.652454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.652390 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-service-ca\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.652733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.652712 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-trusted-ca-bundle\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.652733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.652723 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-config\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.654290 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.654267 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-oauth-config\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.654422 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.654400 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-serving-cert\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.660098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.660070 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gkd\" (UniqueName: \"kubernetes.io/projected/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-kube-api-access-c9gkd\") pod \"console-5b4886-b8jxz\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:10.758276 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:10.758169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:16.611726 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:16.611695 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4886-b8jxz"] Jun 11 12:25:16.614554 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:25:16.614515 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff7c993_0fe1_48a8_a8cf_f11d157f571b.slice/crio-f09cb680c3a3da7bfdef2bcbb258825debbd7038b70b0b2278707c89481e6a79 WatchSource:0}: Error finding container f09cb680c3a3da7bfdef2bcbb258825debbd7038b70b0b2278707c89481e6a79: Status 404 returned error can't find the container with id f09cb680c3a3da7bfdef2bcbb258825debbd7038b70b0b2278707c89481e6a79 Jun 11 12:25:16.699602 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:16.699570 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4886-b8jxz" event={"ID":"1ff7c993-0fe1-48a8-a8cf-f11d157f571b","Type":"ContainerStarted","Data":"f09cb680c3a3da7bfdef2bcbb258825debbd7038b70b0b2278707c89481e6a79"} Jun 11 12:25:17.707183 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:17.707129 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vs7mj" event={"ID":"2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8","Type":"ContainerStarted","Data":"a819621c94f2ae5ae4fa2ed01c69310eefa90c728335e686e0322bebb0eec777"} Jun 11 12:25:17.707669 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:17.707437 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:25:17.720475 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:17.720421 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-vs7mj" Jun 11 12:25:17.729822 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:17.729221 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-vs7mj" podStartSLOduration=1.85550186 podStartE2EDuration="19.729203102s" totalImagesPullingTime="17.873701242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:17.727947619 +0000 UTC m=+246.181558715" watchObservedRunningTime="2026-06-11 12:25:17.729203102 +0000 UTC m=+246.182814201" Jun 11 12:25:18.336344 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:18.336275 2569 patch_prober.go:28] interesting pod/image-registry-57fdc95979-z6gzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:25:18.336344 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:18.336341 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:25:20.721466 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:20.721385 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4886-b8jxz" event={"ID":"1ff7c993-0fe1-48a8-a8cf-f11d157f571b","Type":"ContainerStarted","Data":"5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876"} Jun 11 12:25:20.758388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:20.758358 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:20.758537 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:20.758415 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:25:20.759924 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:20.759897 2569 patch_prober.go:28] interesting pod/console-5b4886-b8jxz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 12:25:20.760056 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:20.759942 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b4886-b8jxz" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 12:25:23.349325 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.349276 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" containerID="cri-o://74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764" gracePeriod=30 Jun 11 12:25:23.635129 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.635102 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:25:23.655604 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.655560 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4886-b8jxz" podStartSLOduration=9.819920146 podStartE2EDuration="13.655528747s" totalImagesPullingTime="3.835608601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:20.741676171 +0000 UTC m=+249.195287267" watchObservedRunningTime="2026-06-11 12:25:23.655528747 +0000 UTC m=+252.109139844" Jun 11 12:25:23.734271 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.734239 2569 generic.go:356] "Generic (PLEG): container finished" podID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerID="74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764" exitCode=0 Jun 11 12:25:23.734406 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.734290 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" Jun 11 12:25:23.734406 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.734336 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" event={"ID":"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff","Type":"ContainerDied","Data":"74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764"} Jun 11 12:25:23.734406 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.734393 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fdc95979-z6gzk" event={"ID":"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff","Type":"ContainerDied","Data":"c67cc867aed42e512541865a3188b560a92ec161dbdf52968da3cc96fc7546a5"} Jun 11 12:25:23.734598 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.734422 2569 scope.go:117] "RemoveContainer" containerID="74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764" Jun 11 12:25:23.743373 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.743354 2569 scope.go:117] "RemoveContainer" containerID="74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764" Jun 11 12:25:23.743704 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:25:23.743678 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764\": container with ID starting with 74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764 not found: ID does not exist" containerID="74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764" Jun 11 12:25:23.743780 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.743709 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764"} err="failed to get container status \"74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764\": rpc error: code = NotFound desc = could not find container \"74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764\": container with ID starting with 74eeb81d1886b4a942e7bcf50e87b4f063b9d685fd930b975ea15e74e4878764 not found: ID does not exist" Jun 11 12:25:23.758979 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.758956 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdrqd\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-kube-api-access-pdrqd\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759075 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.758990 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-certificates\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759075 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759047 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-ca-trust-extracted\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759179 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759077 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-bound-sa-token\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759179 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759121 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-trusted-ca\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759179 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759152 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759326 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759241 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-installation-pull-secrets\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759326 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759287 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-image-registry-private-configuration\") pod \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\" (UID: \"8ecf2cfe-a6c7-4491-85e6-61b22b94ebff\") " Jun 11 12:25:23.759888 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759450 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:25:23.759888 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:25:23.759888 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759524 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:25:23.759888 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759607 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-trusted-ca\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.759888 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.759631 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-certificates\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.762217 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.762173 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:25:23.762343 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.762321 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:25:23.762413 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.762344 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-kube-api-access-pdrqd" (OuterVolumeSpecName: "kube-api-access-pdrqd") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "kube-api-access-pdrqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:25:23.762748 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.762713 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:25:23.762847 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.762761 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:25:23.763097 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.763076 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e357e063-6064-47cf-8dc3-09684c032c6c-metrics-certs\") pod \"network-metrics-daemon-fc84k\" (UID: \"e357e063-6064-47cf-8dc3-09684c032c6c\") " pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:25:23.772422 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.772396 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" (UID: "8ecf2cfe-a6c7-4491-85e6-61b22b94ebff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:25:23.860550 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.860489 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-ca-trust-extracted\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.860550 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.860511 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-bound-sa-token\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.860550 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.860521 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-registry-tls\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.860550 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.860529 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-installation-pull-secrets\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.860782 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.860558 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-image-registry-private-configuration\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.860782 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.860572 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdrqd\" (UniqueName: \"kubernetes.io/projected/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff-kube-api-access-pdrqd\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:25:23.948672 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.948651 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v492\"" Jun 11 12:25:23.956004 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:23.955981 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc84k" Jun 11 12:25:24.053960 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:24.053929 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57fdc95979-z6gzk"] Jun 11 12:25:24.057642 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:24.057616 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57fdc95979-z6gzk"] Jun 11 12:25:24.124514 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:24.124301 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fc84k"] Jun 11 12:25:24.127281 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:25:24.127250 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode357e063_6064_47cf_8dc3_09684c032c6c.slice/crio-c3d217356e6684bdc3161f43c02cb10126ffed4e566c9d2650cb0a74df2e6a36 WatchSource:0}: Error finding container c3d217356e6684bdc3161f43c02cb10126ffed4e566c9d2650cb0a74df2e6a36: Status 404 returned error can't find the container with id c3d217356e6684bdc3161f43c02cb10126ffed4e566c9d2650cb0a74df2e6a36 Jun 11 12:25:24.740459 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:24.740412 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc84k" event={"ID":"e357e063-6064-47cf-8dc3-09684c032c6c","Type":"ContainerStarted","Data":"c3d217356e6684bdc3161f43c02cb10126ffed4e566c9d2650cb0a74df2e6a36"} Jun 11 12:25:25.746746 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:25.746712 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc84k" event={"ID":"e357e063-6064-47cf-8dc3-09684c032c6c","Type":"ContainerStarted","Data":"6c15dac103e91383361ed09d2240d6776ca534c337600823973162b0c2076ab3"} Jun 11 12:25:25.952639 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:25.952598 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" path="/var/lib/kubelet/pods/8ecf2cfe-a6c7-4491-85e6-61b22b94ebff/volumes" Jun 11 12:25:26.751185 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:26.751149 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc84k" event={"ID":"e357e063-6064-47cf-8dc3-09684c032c6c","Type":"ContainerStarted","Data":"50dd9d37051fda1557eed849c50fa91cd369f17425a4bc9d2472b398d63805c9"} Jun 11 12:25:26.768791 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:26.768745 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fc84k" podStartSLOduration=253.322588425 podStartE2EDuration="4m14.768726787s" totalImagesPullingTime="1.446138362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:26.768222812 +0000 UTC m=+255.221833908" watchObservedRunningTime="2026-06-11 12:25:26.768726787 +0000 UTC m=+255.222337883" Jun 11 12:25:30.758863 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:30.758785 2569 patch_prober.go:28] interesting pod/console-5b4886-b8jxz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 12:25:30.758863 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:30.758826 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b4886-b8jxz" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 12:25:40.759313 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:40.759277 2569 patch_prober.go:28] interesting pod/console-5b4886-b8jxz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 12:25:40.759688 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:40.759325 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b4886-b8jxz" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 12:25:41.438856 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:41.438832 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7pwl8_c8e1e3e1-678a-4536-9383-a6faede09b50/kube-state-metrics/0.log" Jun 11 12:25:41.649850 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:41.649822 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7pwl8_c8e1e3e1-678a-4536-9383-a6faede09b50/kube-rbac-proxy-main/0.log" Jun 11 12:25:41.838310 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:41.838248 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7pwl8_c8e1e3e1-678a-4536-9383-a6faede09b50/kube-rbac-proxy-self/0.log" Jun 11 12:25:43.639033 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:43.639005 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm98p_5a34a99f-3c54-4adf-9c10-bb2692340d3b/init-textfile/0.log" Jun 11 12:25:43.839345 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:43.839320 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm98p_5a34a99f-3c54-4adf-9c10-bb2692340d3b/node-exporter/0.log" Jun 11 12:25:44.038366 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:44.038342 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm98p_5a34a99f-3c54-4adf-9c10-bb2692340d3b/kube-rbac-proxy/0.log" Jun 11 12:25:44.238115 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:44.238090 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nbr5s_1a6fe3e8-46c4-42b0-be71-38a177a60f00/kube-rbac-proxy-main/0.log" Jun 11 12:25:44.438523 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:44.438487 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nbr5s_1a6fe3e8-46c4-42b0-be71-38a177a60f00/kube-rbac-proxy-self/0.log" Jun 11 12:25:44.639110 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:44.639085 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nbr5s_1a6fe3e8-46c4-42b0-be71-38a177a60f00/openshift-state-metrics/0.log" Jun 11 12:25:46.237661 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:46.237629 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:25:46.439557 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:46.439513 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/2.log" Jun 11 12:25:46.638769 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:46.638706 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b4886-b8jxz_1ff7c993-0fe1-48a8-a8cf-f11d157f571b/console/0.log" Jun 11 12:25:47.239983 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:47.239956 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-vs7mj_2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8/download-server/0.log" Jun 11 12:25:49.037991 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:49.037963 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xj49p_916fca5e-e135-4925-bf87-5ba50b1e3925/dns-node-resolver/0.log" Jun 11 12:25:49.838919 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:49.838886 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ck4gh_f88c2ec3-858c-4985-88a4-a7521051c799/node-ca/0.log" Jun 11 12:25:50.238210 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:50.238186 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dcf8c4d4f-g2kcl_568bbb4d-94a7-4257-a01a-4c87703a586c/router/0.log" Jun 11 12:25:50.758830 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:50.758792 2569 patch_prober.go:28] interesting pod/console-5b4886-b8jxz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 12:25:50.759012 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:50.758855 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b4886-b8jxz" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 12:25:50.838565 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:50.838523 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlp8h_155e8c42-7549-4683-a139-449cfff8da9b/serve-healthcheck-canary/0.log" Jun 11 12:25:56.414863 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:25:56.414825 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qx46k" podUID="46516883-21ad-428c-8a85-e00eae76091a" Jun 11 12:25:56.857499 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:56.857427 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx46k" Jun 11 12:25:59.429041 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:59.429008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:25:59.431180 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:59.431156 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46516883-21ad-428c-8a85-e00eae76091a-metrics-tls\") pod \"dns-default-qx46k\" (UID: \"46516883-21ad-428c-8a85-e00eae76091a\") " pod="openshift-dns/dns-default-qx46k" Jun 11 12:25:59.560830 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:59.560807 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-54jbl\"" Jun 11 12:25:59.568326 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:59.568309 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx46k" Jun 11 12:25:59.725243 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:59.725139 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx46k"] Jun 11 12:25:59.867913 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:25:59.867881 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx46k" event={"ID":"46516883-21ad-428c-8a85-e00eae76091a","Type":"ContainerStarted","Data":"464778891a57f15096359f91e5fce1eda3710343ad1b8309d16df5611444c5a1"} Jun 11 12:26:00.762432 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:00.762398 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:26:00.766072 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:00.766050 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:26:01.877174 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:01.877137 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx46k" event={"ID":"46516883-21ad-428c-8a85-e00eae76091a","Type":"ContainerStarted","Data":"273b95870e965c1a78125a91ed6f3f4ee6c3dba9126bc65d8cb06e93bca81526"} Jun 11 12:26:01.877662 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:01.877189 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx46k" event={"ID":"46516883-21ad-428c-8a85-e00eae76091a","Type":"ContainerStarted","Data":"4f1c2142f1670a4875e8ee70ca9ce587a2b520726654d552edb9ef43130744a5"} Jun 11 12:26:01.877662 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:01.877280 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qx46k" Jun 11 12:26:01.897973 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:01.897932 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qx46k" podStartSLOduration=251.284454797 podStartE2EDuration="4m12.897916043s" totalImagesPullingTime="1.613461246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:26:01.897521023 +0000 UTC m=+290.351132120" watchObservedRunningTime="2026-06-11 12:26:01.897916043 +0000 UTC m=+290.351527139" Jun 11 12:26:06.486499 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:06.486461 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4886-b8jxz"] Jun 11 12:26:11.882472 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:11.882445 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qx46k" Jun 11 12:26:11.892955 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:11.892926 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:26:11.893989 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:11.893708 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:26:11.903299 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:11.903160 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:26:11.904038 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:11.904021 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:26:11.905870 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:11.905849 2569 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 12:26:31.507668 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.507627 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b4886-b8jxz" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" containerID="cri-o://5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876" gracePeriod=15 Jun 11 12:26:31.737510 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.737485 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:26:31.851599 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851511 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9gkd\" (UniqueName: \"kubernetes.io/projected/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-kube-api-access-c9gkd\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.851599 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851563 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-oauth-serving-cert\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.851599 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851598 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-oauth-config\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.851832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851614 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-service-ca\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.851832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851637 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-serving-cert\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.851832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851674 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-trusted-ca-bundle\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.851832 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.851701 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-config\") pod \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\" (UID: \"1ff7c993-0fe1-48a8-a8cf-f11d157f571b\") " Jun 11 12:26:31.852142 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.852099 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:26:31.852142 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.852133 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:26:31.852291 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.852147 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:26:31.852291 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.852155 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-config" (OuterVolumeSpecName: "console-config") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:26:31.853711 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.853686 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-kube-api-access-c9gkd" (OuterVolumeSpecName: "kube-api-access-c9gkd") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "kube-api-access-c9gkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:26:31.853797 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.853753 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:26:31.853797 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.853770 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ff7c993-0fe1-48a8-a8cf-f11d157f571b" (UID: "1ff7c993-0fe1-48a8-a8cf-f11d157f571b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:26:31.952281 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952244 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9gkd\" (UniqueName: \"kubernetes.io/projected/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-kube-api-access-c9gkd\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.952281 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952273 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-oauth-serving-cert\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.952281 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952286 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-oauth-config\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.952500 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952299 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-service-ca\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.952500 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952311 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-serving-cert\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.952500 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952322 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-trusted-ca-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.952500 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.952333 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ff7c993-0fe1-48a8-a8cf-f11d157f571b-console-config\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:26:31.980440 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.980413 2569 generic.go:356] "Generic (PLEG): container finished" podID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerID="5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876" exitCode=0 Jun 11 12:26:31.980580 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.980454 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4886-b8jxz" Jun 11 12:26:31.980580 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.980498 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4886-b8jxz" event={"ID":"1ff7c993-0fe1-48a8-a8cf-f11d157f571b","Type":"ContainerDied","Data":"5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876"} Jun 11 12:26:31.980580 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.980553 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4886-b8jxz" event={"ID":"1ff7c993-0fe1-48a8-a8cf-f11d157f571b","Type":"ContainerDied","Data":"f09cb680c3a3da7bfdef2bcbb258825debbd7038b70b0b2278707c89481e6a79"} Jun 11 12:26:31.980580 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.980574 2569 scope.go:117] "RemoveContainer" containerID="5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876" Jun 11 12:26:31.988223 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.988207 2569 scope.go:117] "RemoveContainer" containerID="5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876" Jun 11 12:26:31.988482 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:26:31.988459 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876\": container with ID starting with 5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876 not found: ID does not exist" containerID="5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876" Jun 11 12:26:31.988600 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.988487 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876"} err="failed to get container status \"5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876\": rpc error: code = NotFound desc = could not find container \"5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876\": container with ID starting with 5e1ee4508258cab3ce96d3b2b3da3b8e5f2f78a2ee06d77ce71e9364fd00e876 not found: ID does not exist" Jun 11 12:26:31.998228 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:31.998202 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4886-b8jxz"] Jun 11 12:26:32.004585 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:32.004567 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4886-b8jxz"] Jun 11 12:26:33.950143 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:26:33.950110 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" path="/var/lib/kubelet/pods/1ff7c993-0fe1-48a8-a8cf-f11d157f571b/volumes" Jun 11 12:31:11.925754 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:11.925726 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:31:11.926263 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:11.926064 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:31:11.933790 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:11.933767 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:31:11.933880 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:11.933835 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:31:30.660986 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.660959 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846cc6d895-8jzpl"] Jun 11 12:31:30.661414 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.661223 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" Jun 11 12:31:30.661414 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.661235 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" Jun 11 12:31:30.661414 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.661244 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" Jun 11 12:31:30.661414 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.661250 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" Jun 11 12:31:30.661414 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.661298 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ff7c993-0fe1-48a8-a8cf-f11d157f571b" containerName="console" Jun 11 12:31:30.661414 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.661305 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ecf2cfe-a6c7-4491-85e6-61b22b94ebff" containerName="registry" Jun 11 12:31:30.664323 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.664304 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.668714 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.668694 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 12:31:30.669037 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.668793 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 12:31:30.669037 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.668808 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 12:31:30.669037 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.668694 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9glsz\"" Jun 11 12:31:30.669037 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.668750 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 12:31:30.669316 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.669053 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 12:31:30.673364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.673346 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 12:31:30.677482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.677458 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846cc6d895-8jzpl"] Jun 11 12:31:30.761583 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761538 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjfwg\" (UniqueName: \"kubernetes.io/projected/038bacc1-fdcf-4205-bc4c-a71394f13c2c-kube-api-access-mjfwg\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.761683 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-oauth-config\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.761683 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-oauth-serving-cert\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.761683 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761668 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-config\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.761784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-trusted-ca-bundle\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.761784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761748 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-serving-cert\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.761784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.761771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-service-ca\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862633 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862607 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-trusted-ca-bundle\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-serving-cert\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-service-ca\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjfwg\" (UniqueName: \"kubernetes.io/projected/038bacc1-fdcf-4205-bc4c-a71394f13c2c-kube-api-access-mjfwg\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862691 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-oauth-config\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-oauth-serving-cert\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.862973 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.862757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-config\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.863424 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.863402 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-service-ca\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.863582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.863418 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-config\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.863672 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.863516 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-oauth-serving-cert\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.863672 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.863516 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-trusted-ca-bundle\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.865056 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.865028 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-oauth-config\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.865162 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.865145 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-serving-cert\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.873256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.873235 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjfwg\" (UniqueName: \"kubernetes.io/projected/038bacc1-fdcf-4205-bc4c-a71394f13c2c-kube-api-access-mjfwg\") pod \"console-846cc6d895-8jzpl\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:30.975494 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:30.975448 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:31.101074 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:31.101051 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846cc6d895-8jzpl"] Jun 11 12:31:31.102940 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:31:31.102911 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038bacc1_fdcf_4205_bc4c_a71394f13c2c.slice/crio-26571c1ea9e565508c1fb7720f9e7ae34cb6a942f1d9aa587780eb1d1fa58481 WatchSource:0}: Error finding container 26571c1ea9e565508c1fb7720f9e7ae34cb6a942f1d9aa587780eb1d1fa58481: Status 404 returned error can't find the container with id 26571c1ea9e565508c1fb7720f9e7ae34cb6a942f1d9aa587780eb1d1fa58481 Jun 11 12:31:31.907911 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:31.907883 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846cc6d895-8jzpl" event={"ID":"038bacc1-fdcf-4205-bc4c-a71394f13c2c","Type":"ContainerStarted","Data":"36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938"} Jun 11 12:31:31.910149 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:31.907952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846cc6d895-8jzpl" event={"ID":"038bacc1-fdcf-4205-bc4c-a71394f13c2c","Type":"ContainerStarted","Data":"26571c1ea9e565508c1fb7720f9e7ae34cb6a942f1d9aa587780eb1d1fa58481"} Jun 11 12:31:31.935655 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:31.935612 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846cc6d895-8jzpl" podStartSLOduration=1.9355970550000001 podStartE2EDuration="1.935597055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:31:31.934100192 +0000 UTC m=+620.387711290" watchObservedRunningTime="2026-06-11 12:31:31.935597055 +0000 UTC m=+620.389208152" Jun 11 12:31:40.975999 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:40.975969 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:40.976347 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:40.976017 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:40.980193 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:40.980174 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:31:41.942761 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:31:41.942732 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:35:40.380833 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.380796 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fb667b94b-7t8hc"] Jun 11 12:35:40.384030 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.384008 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.405387 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.405361 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb667b94b-7t8hc"] Jun 11 12:35:40.477956 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.477920 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-trusted-ca-bundle\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.477956 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.477955 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95f34a27-9b82-4991-b94c-6393560750e5-console-serving-cert\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.478164 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.477982 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-oauth-serving-cert\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.478164 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.478047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-service-ca\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.478164 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.478104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95f34a27-9b82-4991-b94c-6393560750e5-console-oauth-config\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.478164 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.478151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4v2d\" (UniqueName: \"kubernetes.io/projected/95f34a27-9b82-4991-b94c-6393560750e5-kube-api-access-m4v2d\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.478302 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.478169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-console-config\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579338 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-console-config\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579486 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-trusted-ca-bundle\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579486 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579365 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95f34a27-9b82-4991-b94c-6393560750e5-console-serving-cert\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579486 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-oauth-serving-cert\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579486 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579422 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-service-ca\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579486 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579463 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95f34a27-9b82-4991-b94c-6393560750e5-console-oauth-config\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.579733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.579496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4v2d\" (UniqueName: \"kubernetes.io/projected/95f34a27-9b82-4991-b94c-6393560750e5-kube-api-access-m4v2d\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.580196 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.580158 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-console-config\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.580315 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.580223 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-service-ca\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.580315 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.580231 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-oauth-serving-cert\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.580315 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.580264 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95f34a27-9b82-4991-b94c-6393560750e5-trusted-ca-bundle\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.581875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.581848 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95f34a27-9b82-4991-b94c-6393560750e5-console-serving-cert\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.581974 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.581885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95f34a27-9b82-4991-b94c-6393560750e5-console-oauth-config\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.588253 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.588228 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4v2d\" (UniqueName: \"kubernetes.io/projected/95f34a27-9b82-4991-b94c-6393560750e5-kube-api-access-m4v2d\") pod \"console-6fb667b94b-7t8hc\" (UID: \"95f34a27-9b82-4991-b94c-6393560750e5\") " pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.693214 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.693187 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:40.819980 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:40.819907 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb667b94b-7t8hc"] Jun 11 12:35:40.822461 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:35:40.822434 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f34a27_9b82_4991_b94c_6393560750e5.slice/crio-4713fc65e454a500b5391e2b37388951569cd04e3fee6506a120973df960e770 WatchSource:0}: Error finding container 4713fc65e454a500b5391e2b37388951569cd04e3fee6506a120973df960e770: Status 404 returned error can't find the container with id 4713fc65e454a500b5391e2b37388951569cd04e3fee6506a120973df960e770 Jun 11 12:35:41.749428 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:41.749394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb667b94b-7t8hc" event={"ID":"95f34a27-9b82-4991-b94c-6393560750e5","Type":"ContainerStarted","Data":"2cf89bb0b1cb0485b5b1658aa0f5e0be164da7f18c109aaa982db4b5b478f5f7"} Jun 11 12:35:41.749428 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:41.749444 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb667b94b-7t8hc" event={"ID":"95f34a27-9b82-4991-b94c-6393560750e5","Type":"ContainerStarted","Data":"4713fc65e454a500b5391e2b37388951569cd04e3fee6506a120973df960e770"} Jun 11 12:35:41.770404 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:41.770359 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fb667b94b-7t8hc" podStartSLOduration=1.770344294 podStartE2EDuration="1.770344294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:35:41.768661083 +0000 UTC m=+870.222272203" watchObservedRunningTime="2026-06-11 12:35:41.770344294 +0000 UTC m=+870.223955390" Jun 11 12:35:50.693604 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:50.693567 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:50.694126 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:50.693646 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:50.698331 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:50.698308 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:50.785829 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:50.785805 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fb667b94b-7t8hc" Jun 11 12:35:50.836207 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:35:50.836166 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846cc6d895-8jzpl"] Jun 11 12:36:11.948770 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:11.948735 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:36:11.949283 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:11.949265 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:36:11.956905 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:11.956882 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:36:11.957581 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:11.957560 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:36:15.857331 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:15.857288 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-846cc6d895-8jzpl" podUID="038bacc1-fdcf-4205-bc4c-a71394f13c2c" containerName="console" containerID="cri-o://36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938" gracePeriod=15 Jun 11 12:36:16.093315 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.093292 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:36:16.256861 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.256818 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-config\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.256861 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.256865 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjfwg\" (UniqueName: \"kubernetes.io/projected/038bacc1-fdcf-4205-bc4c-a71394f13c2c-kube-api-access-mjfwg\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.257098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.256887 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-trusted-ca-bundle\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.257098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.256906 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-oauth-serving-cert\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.257098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.256922 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-service-ca\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.257098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.256973 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-oauth-config\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.257098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.257001 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-serving-cert\") pod \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\" (UID: \"038bacc1-fdcf-4205-bc4c-a71394f13c2c\") " Jun 11 12:36:16.257331 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.257282 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-config" (OuterVolumeSpecName: "console-config") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:36:16.257384 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.257322 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:36:16.257454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.257426 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:36:16.257567 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.257511 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-service-ca" (OuterVolumeSpecName: "service-ca") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:36:16.259160 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.259136 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:36:16.259263 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.259169 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038bacc1-fdcf-4205-bc4c-a71394f13c2c-kube-api-access-mjfwg" (OuterVolumeSpecName: "kube-api-access-mjfwg") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "kube-api-access-mjfwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:36:16.259320 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.259302 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "038bacc1-fdcf-4205-bc4c-a71394f13c2c" (UID: "038bacc1-fdcf-4205-bc4c-a71394f13c2c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:36:16.357461 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357434 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-serving-cert\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.357584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357459 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-config\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.357584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357481 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjfwg\" (UniqueName: \"kubernetes.io/projected/038bacc1-fdcf-4205-bc4c-a71394f13c2c-kube-api-access-mjfwg\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.357584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357490 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-trusted-ca-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.357584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357498 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-oauth-serving-cert\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.357584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357506 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/038bacc1-fdcf-4205-bc4c-a71394f13c2c-service-ca\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.357584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.357514 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/038bacc1-fdcf-4205-bc4c-a71394f13c2c-console-oauth-config\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:36:16.870267 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.870228 2569 generic.go:356] "Generic (PLEG): container finished" podID="038bacc1-fdcf-4205-bc4c-a71394f13c2c" containerID="36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938" exitCode=0 Jun 11 12:36:16.870267 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.870268 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846cc6d895-8jzpl" Jun 11 12:36:16.870708 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.870320 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846cc6d895-8jzpl" event={"ID":"038bacc1-fdcf-4205-bc4c-a71394f13c2c","Type":"ContainerDied","Data":"36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938"} Jun 11 12:36:16.870708 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.870371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846cc6d895-8jzpl" event={"ID":"038bacc1-fdcf-4205-bc4c-a71394f13c2c","Type":"ContainerDied","Data":"26571c1ea9e565508c1fb7720f9e7ae34cb6a942f1d9aa587780eb1d1fa58481"} Jun 11 12:36:16.870708 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.870393 2569 scope.go:117] "RemoveContainer" containerID="36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938" Jun 11 12:36:16.879180 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.879161 2569 scope.go:117] "RemoveContainer" containerID="36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938" Jun 11 12:36:16.879430 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:36:16.879413 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938\": container with ID starting with 36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938 not found: ID does not exist" containerID="36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938" Jun 11 12:36:16.879478 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.879437 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938"} err="failed to get container status \"36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938\": rpc error: code = NotFound desc = could not find container \"36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938\": container with ID starting with 36fd662def3df395614096cb85576f00f99405749318c158ee39940547551938 not found: ID does not exist" Jun 11 12:36:16.894750 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.894725 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846cc6d895-8jzpl"] Jun 11 12:36:16.898678 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:16.898659 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846cc6d895-8jzpl"] Jun 11 12:36:17.949449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:36:17.949417 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038bacc1-fdcf-4205-bc4c-a71394f13c2c" path="/var/lib/kubelet/pods/038bacc1-fdcf-4205-bc4c-a71394f13c2c/volumes" Jun 11 12:37:38.341868 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.341775 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf"] Jun 11 12:37:38.342274 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.342120 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038bacc1-fdcf-4205-bc4c-a71394f13c2c" containerName="console" Jun 11 12:37:38.342274 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.342135 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="038bacc1-fdcf-4205-bc4c-a71394f13c2c" containerName="console" Jun 11 12:37:38.342274 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.342193 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="038bacc1-fdcf-4205-bc4c-a71394f13c2c" containerName="console" Jun 11 12:37:38.344950 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.344929 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.348358 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.348335 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6d8vq\"" Jun 11 12:37:38.348475 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.348394 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 12:37:38.348475 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.348397 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 12:37:38.358476 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.358452 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf"] Jun 11 12:37:38.462183 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.462140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.462364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.462194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.462364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.462235 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbnf\" (UniqueName: \"kubernetes.io/projected/000ea3a8-a026-46b8-9591-f25c80d63725-kube-api-access-cnbnf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.563256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.563219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbnf\" (UniqueName: \"kubernetes.io/projected/000ea3a8-a026-46b8-9591-f25c80d63725-kube-api-access-cnbnf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.563256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.563292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.563495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.563337 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.563717 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.563699 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.563775 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.563760 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.572860 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.572835 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbnf\" (UniqueName: \"kubernetes.io/projected/000ea3a8-a026-46b8-9591-f25c80d63725-kube-api-access-cnbnf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.653814 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.653785 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:37:38.777523 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.777498 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf"] Jun 11 12:37:38.779912 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:37:38.779887 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000ea3a8_a026_46b8_9591_f25c80d63725.slice/crio-a5fe6f1d2a7a4c070a77ebd8a36ec50292154ec4d2f73589effcfd5c9e9a23a4 WatchSource:0}: Error finding container a5fe6f1d2a7a4c070a77ebd8a36ec50292154ec4d2f73589effcfd5c9e9a23a4: Status 404 returned error can't find the container with id a5fe6f1d2a7a4c070a77ebd8a36ec50292154ec4d2f73589effcfd5c9e9a23a4 Jun 11 12:37:38.782359 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:38.782339 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:37:39.161382 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:39.161349 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" event={"ID":"000ea3a8-a026-46b8-9591-f25c80d63725","Type":"ContainerStarted","Data":"a5fe6f1d2a7a4c070a77ebd8a36ec50292154ec4d2f73589effcfd5c9e9a23a4"} Jun 11 12:37:49.201758 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:49.201713 2569 generic.go:356] "Generic (PLEG): container finished" podID="000ea3a8-a026-46b8-9591-f25c80d63725" containerID="b60cf3f676b4c4383787ca02ffdd26941374ba4f8a05ca296a4522c07d7cc144" exitCode=0 Jun 11 12:37:49.202189 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:49.201783 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" event={"ID":"000ea3a8-a026-46b8-9591-f25c80d63725","Type":"ContainerDied","Data":"b60cf3f676b4c4383787ca02ffdd26941374ba4f8a05ca296a4522c07d7cc144"} Jun 11 12:37:50.207015 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:50.206981 2569 generic.go:356] "Generic (PLEG): container finished" podID="000ea3a8-a026-46b8-9591-f25c80d63725" containerID="b35d496ae02b6c01474ee551a8ef0b6b41d3a9585343a6724080595593acd276" exitCode=0 Jun 11 12:37:50.207396 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:37:50.207020 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" event={"ID":"000ea3a8-a026-46b8-9591-f25c80d63725","Type":"ContainerDied","Data":"b35d496ae02b6c01474ee551a8ef0b6b41d3a9585343a6724080595593acd276"} Jun 11 12:38:01.251157 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:01.251107 2569 generic.go:356] "Generic (PLEG): container finished" podID="000ea3a8-a026-46b8-9591-f25c80d63725" containerID="8119e2fb3776818f2d62ed846a7f061986cbd7815e28e285aab55b3c4974610d" exitCode=0 Jun 11 12:38:01.251157 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:01.251150 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" event={"ID":"000ea3a8-a026-46b8-9591-f25c80d63725","Type":"ContainerDied","Data":"8119e2fb3776818f2d62ed846a7f061986cbd7815e28e285aab55b3c4974610d"} Jun 11 12:38:02.380042 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.380015 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:38:02.450593 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.450530 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnbnf\" (UniqueName: \"kubernetes.io/projected/000ea3a8-a026-46b8-9591-f25c80d63725-kube-api-access-cnbnf\") pod \"000ea3a8-a026-46b8-9591-f25c80d63725\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " Jun 11 12:38:02.450786 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.450639 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-util\") pod \"000ea3a8-a026-46b8-9591-f25c80d63725\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " Jun 11 12:38:02.450786 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.450672 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-bundle\") pod \"000ea3a8-a026-46b8-9591-f25c80d63725\" (UID: \"000ea3a8-a026-46b8-9591-f25c80d63725\") " Jun 11 12:38:02.451399 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.451366 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-bundle" (OuterVolumeSpecName: "bundle") pod "000ea3a8-a026-46b8-9591-f25c80d63725" (UID: "000ea3a8-a026-46b8-9591-f25c80d63725"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:38:02.453195 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.453159 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/000ea3a8-a026-46b8-9591-f25c80d63725-kube-api-access-cnbnf" (OuterVolumeSpecName: "kube-api-access-cnbnf") pod "000ea3a8-a026-46b8-9591-f25c80d63725" (UID: "000ea3a8-a026-46b8-9591-f25c80d63725"). InnerVolumeSpecName "kube-api-access-cnbnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:38:02.455176 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.455152 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-util" (OuterVolumeSpecName: "util") pod "000ea3a8-a026-46b8-9591-f25c80d63725" (UID: "000ea3a8-a026-46b8-9591-f25c80d63725"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:38:02.552077 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.551985 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:02.552077 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.552021 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnbnf\" (UniqueName: \"kubernetes.io/projected/000ea3a8-a026-46b8-9591-f25c80d63725-kube-api-access-cnbnf\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:02.552077 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:02.552031 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/000ea3a8-a026-46b8-9591-f25c80d63725-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:03.260759 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:03.260728 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" Jun 11 12:38:03.260942 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:03.260766 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn4zbf" event={"ID":"000ea3a8-a026-46b8-9591-f25c80d63725","Type":"ContainerDied","Data":"a5fe6f1d2a7a4c070a77ebd8a36ec50292154ec4d2f73589effcfd5c9e9a23a4"} Jun 11 12:38:03.260942 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:03.260824 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5fe6f1d2a7a4c070a77ebd8a36ec50292154ec4d2f73589effcfd5c9e9a23a4" Jun 11 12:38:06.659037 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.658997 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl"] Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659283 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="extract" Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659295 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="extract" Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659305 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="pull" Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659310 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="pull" Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659321 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="util" Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659326 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="util" Jun 11 12:38:06.659482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.659367 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="000ea3a8-a026-46b8-9591-f25c80d63725" containerName="extract" Jun 11 12:38:06.661197 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.661177 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.665727 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.665701 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 12:38:06.665881 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.665701 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:38:06.665955 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.665942 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g9n2t\"" Jun 11 12:38:06.683721 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.683682 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9f800e-0e79-42bd-be7b-175e566a0d1f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lktkl\" (UID: \"fa9f800e-0e79-42bd-be7b-175e566a0d1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.683870 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.683728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdt9s\" (UniqueName: \"kubernetes.io/projected/fa9f800e-0e79-42bd-be7b-175e566a0d1f-kube-api-access-kdt9s\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lktkl\" (UID: \"fa9f800e-0e79-42bd-be7b-175e566a0d1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.696174 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.696135 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl"] Jun 11 12:38:06.785066 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.785020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9f800e-0e79-42bd-be7b-175e566a0d1f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lktkl\" (UID: \"fa9f800e-0e79-42bd-be7b-175e566a0d1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.785066 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.785066 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdt9s\" (UniqueName: \"kubernetes.io/projected/fa9f800e-0e79-42bd-be7b-175e566a0d1f-kube-api-access-kdt9s\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lktkl\" (UID: \"fa9f800e-0e79-42bd-be7b-175e566a0d1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.785501 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.785478 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9f800e-0e79-42bd-be7b-175e566a0d1f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lktkl\" (UID: \"fa9f800e-0e79-42bd-be7b-175e566a0d1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.799171 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.799139 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdt9s\" (UniqueName: \"kubernetes.io/projected/fa9f800e-0e79-42bd-be7b-175e566a0d1f-kube-api-access-kdt9s\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lktkl\" (UID: \"fa9f800e-0e79-42bd-be7b-175e566a0d1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:06.970696 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:06.970609 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" Jun 11 12:38:07.111127 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:07.111083 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl"] Jun 11 12:38:07.115098 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:38:07.115070 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9f800e_0e79_42bd_be7b_175e566a0d1f.slice/crio-64e39086c6d2bcd36b268f7fc8b6f58efd5e4d478cd4c018fd21d07758832b54 WatchSource:0}: Error finding container 64e39086c6d2bcd36b268f7fc8b6f58efd5e4d478cd4c018fd21d07758832b54: Status 404 returned error can't find the container with id 64e39086c6d2bcd36b268f7fc8b6f58efd5e4d478cd4c018fd21d07758832b54 Jun 11 12:38:07.277645 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:07.277530 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" event={"ID":"fa9f800e-0e79-42bd-be7b-175e566a0d1f","Type":"ContainerStarted","Data":"64e39086c6d2bcd36b268f7fc8b6f58efd5e4d478cd4c018fd21d07758832b54"} Jun 11 12:38:10.291658 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.291621 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" event={"ID":"fa9f800e-0e79-42bd-be7b-175e566a0d1f","Type":"ContainerStarted","Data":"9160acc8fa24c20c8d003503926a124183c414a51c07f94b3ce2974ce1df820f"} Jun 11 12:38:10.325183 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.325123 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lktkl" podStartSLOduration=2.128865222 podStartE2EDuration="4.325105562s" totalImagesPullingTime="2.19624034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:38:10.322876117 +0000 UTC m=+1018.776487216" watchObservedRunningTime="2026-06-11 12:38:10.325105562 +0000 UTC m=+1018.778716660" Jun 11 12:38:10.894471 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.894432 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c"] Jun 11 12:38:10.896845 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.896823 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:10.899789 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.899732 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 12:38:10.899789 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.899745 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 12:38:10.901197 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.901180 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6d8vq\"" Jun 11 12:38:10.909936 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.909902 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c"] Jun 11 12:38:10.919933 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.919899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:10.920167 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.920138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:10.920312 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:10.920223 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cflph\" (UniqueName: \"kubernetes.io/projected/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-kube-api-access-cflph\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.021466 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.021424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.021685 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.021492 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.021685 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.021528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cflph\" (UniqueName: \"kubernetes.io/projected/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-kube-api-access-cflph\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.021941 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.021917 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.021941 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.021933 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.035418 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.035380 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cflph\" (UniqueName: \"kubernetes.io/projected/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-kube-api-access-cflph\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.206116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.206082 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:11.353160 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.352598 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c"] Jun 11 12:38:11.951352 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.951322 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv"] Jun 11 12:38:11.953444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.953427 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:11.956710 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.956682 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 12:38:11.957999 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.957982 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-blv78\"" Jun 11 12:38:11.958082 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.957984 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 12:38:11.965657 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:11.965631 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv"] Jun 11 12:38:12.028574 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.028521 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1d5c051-008a-4318-b5c8-5e8b25e4af93-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ffqcv\" (UID: \"e1d5c051-008a-4318-b5c8-5e8b25e4af93\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.028755 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.028634 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7j79\" (UniqueName: \"kubernetes.io/projected/e1d5c051-008a-4318-b5c8-5e8b25e4af93-kube-api-access-f7j79\") pod \"cert-manager-webhook-7dc76cbb94-ffqcv\" (UID: \"e1d5c051-008a-4318-b5c8-5e8b25e4af93\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.129206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.129155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7j79\" (UniqueName: \"kubernetes.io/projected/e1d5c051-008a-4318-b5c8-5e8b25e4af93-kube-api-access-f7j79\") pod \"cert-manager-webhook-7dc76cbb94-ffqcv\" (UID: \"e1d5c051-008a-4318-b5c8-5e8b25e4af93\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.129416 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.129247 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1d5c051-008a-4318-b5c8-5e8b25e4af93-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ffqcv\" (UID: \"e1d5c051-008a-4318-b5c8-5e8b25e4af93\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.139323 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.139289 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7j79\" (UniqueName: \"kubernetes.io/projected/e1d5c051-008a-4318-b5c8-5e8b25e4af93-kube-api-access-f7j79\") pod \"cert-manager-webhook-7dc76cbb94-ffqcv\" (UID: \"e1d5c051-008a-4318-b5c8-5e8b25e4af93\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.139488 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.139458 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1d5c051-008a-4318-b5c8-5e8b25e4af93-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ffqcv\" (UID: \"e1d5c051-008a-4318-b5c8-5e8b25e4af93\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.263227 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.263128 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:12.303268 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.303236 2569 generic.go:356] "Generic (PLEG): container finished" podID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerID="1406b1b89f57f6ce1028f60ef7e13f0ebc695d0c01aa977626e3bcaacf6b6278" exitCode=0 Jun 11 12:38:12.303470 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.303294 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" event={"ID":"56d6abe7-0a7d-4c22-972e-c4b9c239ef19","Type":"ContainerDied","Data":"1406b1b89f57f6ce1028f60ef7e13f0ebc695d0c01aa977626e3bcaacf6b6278"} Jun 11 12:38:12.303470 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.303330 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" event={"ID":"56d6abe7-0a7d-4c22-972e-c4b9c239ef19","Type":"ContainerStarted","Data":"8b99844775a393133558a7e0960457816a74156b0a90251f8c95e90294d68f25"} Jun 11 12:38:12.392201 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:12.392175 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv"] Jun 11 12:38:12.394643 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:38:12.394612 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1d5c051_008a_4318_b5c8_5e8b25e4af93.slice/crio-9263f0281a2c2c7e2ab5667c2388046673a2812e41476de6fe054948cc1a745f WatchSource:0}: Error finding container 9263f0281a2c2c7e2ab5667c2388046673a2812e41476de6fe054948cc1a745f: Status 404 returned error can't find the container with id 9263f0281a2c2c7e2ab5667c2388046673a2812e41476de6fe054948cc1a745f Jun 11 12:38:13.311513 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:13.311478 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" event={"ID":"e1d5c051-008a-4318-b5c8-5e8b25e4af93","Type":"ContainerStarted","Data":"9263f0281a2c2c7e2ab5667c2388046673a2812e41476de6fe054948cc1a745f"} Jun 11 12:38:15.320287 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:15.320246 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" event={"ID":"e1d5c051-008a-4318-b5c8-5e8b25e4af93","Type":"ContainerStarted","Data":"6b799148cd2b8f1030888f6888b42dd03640937aa03776649a985ceb247b924a"} Jun 11 12:38:15.320667 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:15.320327 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:15.322374 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:15.322346 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" event={"ID":"56d6abe7-0a7d-4c22-972e-c4b9c239ef19","Type":"ContainerStarted","Data":"078c0b829742abb21a2e090ad42ff7be62f36a94c85d71d316a5d122a6bf2d46"} Jun 11 12:38:15.357225 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:15.357168 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" podStartSLOduration=1.5098315009999999 podStartE2EDuration="4.357148154s" totalImagesPullingTime="2.847316653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:38:15.337300813 +0000 UTC m=+1023.790911910" watchObservedRunningTime="2026-06-11 12:38:15.357148154 +0000 UTC m=+1023.810759250" Jun 11 12:38:16.328284 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:16.328244 2569 generic.go:356] "Generic (PLEG): container finished" podID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerID="078c0b829742abb21a2e090ad42ff7be62f36a94c85d71d316a5d122a6bf2d46" exitCode=0 Jun 11 12:38:16.328819 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:16.328329 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" event={"ID":"56d6abe7-0a7d-4c22-972e-c4b9c239ef19","Type":"ContainerDied","Data":"078c0b829742abb21a2e090ad42ff7be62f36a94c85d71d316a5d122a6bf2d46"} Jun 11 12:38:17.334592 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:17.334533 2569 generic.go:356] "Generic (PLEG): container finished" podID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerID="18c16556bde0880fbefaec28a67492580178ec99295519fef926955cac797a32" exitCode=0 Jun 11 12:38:17.335016 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:17.334639 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" event={"ID":"56d6abe7-0a7d-4c22-972e-c4b9c239ef19","Type":"ContainerDied","Data":"18c16556bde0880fbefaec28a67492580178ec99295519fef926955cac797a32"} Jun 11 12:38:18.461410 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.461385 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:18.580285 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.580245 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-bundle\") pod \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " Jun 11 12:38:18.580455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.580321 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-util\") pod \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " Jun 11 12:38:18.580455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.580353 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cflph\" (UniqueName: \"kubernetes.io/projected/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-kube-api-access-cflph\") pod \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\" (UID: \"56d6abe7-0a7d-4c22-972e-c4b9c239ef19\") " Jun 11 12:38:18.580728 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.580708 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-bundle" (OuterVolumeSpecName: "bundle") pod "56d6abe7-0a7d-4c22-972e-c4b9c239ef19" (UID: "56d6abe7-0a7d-4c22-972e-c4b9c239ef19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:38:18.582489 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.582465 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-kube-api-access-cflph" (OuterVolumeSpecName: "kube-api-access-cflph") pod "56d6abe7-0a7d-4c22-972e-c4b9c239ef19" (UID: "56d6abe7-0a7d-4c22-972e-c4b9c239ef19"). InnerVolumeSpecName "kube-api-access-cflph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:38:18.584999 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.584957 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-util" (OuterVolumeSpecName: "util") pod "56d6abe7-0a7d-4c22-972e-c4b9c239ef19" (UID: "56d6abe7-0a7d-4c22-972e-c4b9c239ef19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:38:18.681149 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.681113 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:18.681149 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.681148 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cflph\" (UniqueName: \"kubernetes.io/projected/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-kube-api-access-cflph\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:18.681336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:18.681160 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d6abe7-0a7d-4c22-972e-c4b9c239ef19-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:19.344228 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:19.344188 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" event={"ID":"56d6abe7-0a7d-4c22-972e-c4b9c239ef19","Type":"ContainerDied","Data":"8b99844775a393133558a7e0960457816a74156b0a90251f8c95e90294d68f25"} Jun 11 12:38:19.344228 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:19.344210 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km6c" Jun 11 12:38:19.344228 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:19.344236 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b99844775a393133558a7e0960457816a74156b0a90251f8c95e90294d68f25" Jun 11 12:38:21.330953 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:21.330920 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ffqcv" Jun 11 12:38:28.797041 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797007 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl"] Jun 11 12:38:28.797479 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797396 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="util" Jun 11 12:38:28.797479 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797415 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="util" Jun 11 12:38:28.797479 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797432 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="extract" Jun 11 12:38:28.797479 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797440 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="extract" Jun 11 12:38:28.797479 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797450 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="pull" Jun 11 12:38:28.797479 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797457 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="pull" Jun 11 12:38:28.797784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.797531 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d6abe7-0a7d-4c22-972e-c4b9c239ef19" containerName="extract" Jun 11 12:38:28.836077 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.836043 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl"] Jun 11 12:38:28.836236 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.836146 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:28.839244 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.839222 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pslxb\"" Jun 11 12:38:28.840469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.840453 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 12:38:28.840529 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.840453 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:38:28.960010 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.959974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc7c8b99-eae9-4309-8184-d0618dd9ddfe-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d5rkl\" (UID: \"fc7c8b99-eae9-4309-8184-d0618dd9ddfe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:28.960175 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:28.960025 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t275w\" (UniqueName: \"kubernetes.io/projected/fc7c8b99-eae9-4309-8184-d0618dd9ddfe-kube-api-access-t275w\") pod \"openshift-lws-operator-fd8ccff4c-d5rkl\" (UID: \"fc7c8b99-eae9-4309-8184-d0618dd9ddfe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:29.061299 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.061220 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc7c8b99-eae9-4309-8184-d0618dd9ddfe-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d5rkl\" (UID: \"fc7c8b99-eae9-4309-8184-d0618dd9ddfe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:29.061299 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.061277 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t275w\" (UniqueName: \"kubernetes.io/projected/fc7c8b99-eae9-4309-8184-d0618dd9ddfe-kube-api-access-t275w\") pod \"openshift-lws-operator-fd8ccff4c-d5rkl\" (UID: \"fc7c8b99-eae9-4309-8184-d0618dd9ddfe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:29.061628 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.061603 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc7c8b99-eae9-4309-8184-d0618dd9ddfe-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d5rkl\" (UID: \"fc7c8b99-eae9-4309-8184-d0618dd9ddfe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:29.069683 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.069659 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t275w\" (UniqueName: \"kubernetes.io/projected/fc7c8b99-eae9-4309-8184-d0618dd9ddfe-kube-api-access-t275w\") pod \"openshift-lws-operator-fd8ccff4c-d5rkl\" (UID: \"fc7c8b99-eae9-4309-8184-d0618dd9ddfe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:29.145184 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.145143 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" Jun 11 12:38:29.291304 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.291276 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl"] Jun 11 12:38:29.293356 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:38:29.293318 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc7c8b99_eae9_4309_8184_d0618dd9ddfe.slice/crio-73c02dc3e69ac35eb72a76c1ec608089742ca5eb1eb305d28e6fe5f036f1de53 WatchSource:0}: Error finding container 73c02dc3e69ac35eb72a76c1ec608089742ca5eb1eb305d28e6fe5f036f1de53: Status 404 returned error can't find the container with id 73c02dc3e69ac35eb72a76c1ec608089742ca5eb1eb305d28e6fe5f036f1de53 Jun 11 12:38:29.391198 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:29.391107 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" event={"ID":"fc7c8b99-eae9-4309-8184-d0618dd9ddfe","Type":"ContainerStarted","Data":"73c02dc3e69ac35eb72a76c1ec608089742ca5eb1eb305d28e6fe5f036f1de53"} Jun 11 12:38:33.415968 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:33.415929 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" event={"ID":"fc7c8b99-eae9-4309-8184-d0618dd9ddfe","Type":"ContainerStarted","Data":"f32c12d8b893382c04bbaeb3323c50cde79dc2e5753987f5f28a6f8fe2921522"} Jun 11 12:38:33.435460 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:33.435405 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5rkl" podStartSLOduration=2.226985055 podStartE2EDuration="5.435389646s" totalImagesPullingTime="3.208404591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:38:33.433938217 +0000 UTC m=+1041.887549310" watchObservedRunningTime="2026-06-11 12:38:33.435389646 +0000 UTC m=+1041.889000745" Jun 11 12:38:47.085709 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.085673 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w"] Jun 11 12:38:47.088188 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.088165 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.091820 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.091796 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6d8vq\"" Jun 11 12:38:47.091952 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.091918 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 12:38:47.093093 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.093072 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 12:38:47.102807 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.102781 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w"] Jun 11 12:38:47.213233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.213190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.213455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.213254 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.213455 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.213345 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqwdl\" (UniqueName: \"kubernetes.io/projected/7bf90b94-3920-4b50-9295-b23a35639def-kube-api-access-nqwdl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.314778 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.314732 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.314973 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.314789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqwdl\" (UniqueName: \"kubernetes.io/projected/7bf90b94-3920-4b50-9295-b23a35639def-kube-api-access-nqwdl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.314973 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.314829 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.315234 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.315208 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.315296 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.315216 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.329461 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.329426 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqwdl\" (UniqueName: \"kubernetes.io/projected/7bf90b94-3920-4b50-9295-b23a35639def-kube-api-access-nqwdl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.397673 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.397574 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:47.562317 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:47.562284 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w"] Jun 11 12:38:47.564485 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:38:47.564457 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf90b94_3920_4b50_9295_b23a35639def.slice/crio-cf6a7ea6f46a1f0fba31a7c890fdad82a308928a515c9747d3c64b9a4fe4ebb6 WatchSource:0}: Error finding container cf6a7ea6f46a1f0fba31a7c890fdad82a308928a515c9747d3c64b9a4fe4ebb6: Status 404 returned error can't find the container with id cf6a7ea6f46a1f0fba31a7c890fdad82a308928a515c9747d3c64b9a4fe4ebb6 Jun 11 12:38:48.481436 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:48.481398 2569 generic.go:356] "Generic (PLEG): container finished" podID="7bf90b94-3920-4b50-9295-b23a35639def" containerID="d787b1dae27d79904401a297e5ea0ef442c33555f13cfae0cf986704ca4285e8" exitCode=0 Jun 11 12:38:48.481859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:48.481493 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" event={"ID":"7bf90b94-3920-4b50-9295-b23a35639def","Type":"ContainerDied","Data":"d787b1dae27d79904401a297e5ea0ef442c33555f13cfae0cf986704ca4285e8"} Jun 11 12:38:48.481859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:48.481591 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" event={"ID":"7bf90b94-3920-4b50-9295-b23a35639def","Type":"ContainerStarted","Data":"cf6a7ea6f46a1f0fba31a7c890fdad82a308928a515c9747d3c64b9a4fe4ebb6"} Jun 11 12:38:49.488439 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:49.488402 2569 generic.go:356] "Generic (PLEG): container finished" podID="7bf90b94-3920-4b50-9295-b23a35639def" containerID="a66d160339dc14cd0010243d29d7126a18cbab0593fca9470478739999144679" exitCode=0 Jun 11 12:38:49.488928 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:49.488451 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" event={"ID":"7bf90b94-3920-4b50-9295-b23a35639def","Type":"ContainerDied","Data":"a66d160339dc14cd0010243d29d7126a18cbab0593fca9470478739999144679"} Jun 11 12:38:50.499964 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:50.499925 2569 generic.go:356] "Generic (PLEG): container finished" podID="7bf90b94-3920-4b50-9295-b23a35639def" containerID="f3211adbce1419f4d6c305c17be6cbd5c1c167e8682893f43ea8dd5122b300a4" exitCode=0 Jun 11 12:38:50.500371 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:50.500007 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" event={"ID":"7bf90b94-3920-4b50-9295-b23a35639def","Type":"ContainerDied","Data":"f3211adbce1419f4d6c305c17be6cbd5c1c167e8682893f43ea8dd5122b300a4"} Jun 11 12:38:51.630280 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.630251 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:51.749177 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.749138 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-util\") pod \"7bf90b94-3920-4b50-9295-b23a35639def\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " Jun 11 12:38:51.749351 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.749199 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-bundle\") pod \"7bf90b94-3920-4b50-9295-b23a35639def\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " Jun 11 12:38:51.749351 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.749218 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqwdl\" (UniqueName: \"kubernetes.io/projected/7bf90b94-3920-4b50-9295-b23a35639def-kube-api-access-nqwdl\") pod \"7bf90b94-3920-4b50-9295-b23a35639def\" (UID: \"7bf90b94-3920-4b50-9295-b23a35639def\") " Jun 11 12:38:51.749935 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.749901 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-bundle" (OuterVolumeSpecName: "bundle") pod "7bf90b94-3920-4b50-9295-b23a35639def" (UID: "7bf90b94-3920-4b50-9295-b23a35639def"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:38:51.751285 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.751254 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bf90b94-3920-4b50-9295-b23a35639def-kube-api-access-nqwdl" (OuterVolumeSpecName: "kube-api-access-nqwdl") pod "7bf90b94-3920-4b50-9295-b23a35639def" (UID: "7bf90b94-3920-4b50-9295-b23a35639def"). InnerVolumeSpecName "kube-api-access-nqwdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:38:51.754910 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.754887 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-util" (OuterVolumeSpecName: "util") pod "7bf90b94-3920-4b50-9295-b23a35639def" (UID: "7bf90b94-3920-4b50-9295-b23a35639def"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:38:51.849920 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.849828 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:51.849920 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.849881 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bf90b94-3920-4b50-9295-b23a35639def-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:51.849920 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:51.849891 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqwdl\" (UniqueName: \"kubernetes.io/projected/7bf90b94-3920-4b50-9295-b23a35639def-kube-api-access-nqwdl\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:38:52.511761 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:52.511731 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" Jun 11 12:38:52.512059 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:52.511731 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq6c2w" event={"ID":"7bf90b94-3920-4b50-9295-b23a35639def","Type":"ContainerDied","Data":"cf6a7ea6f46a1f0fba31a7c890fdad82a308928a515c9747d3c64b9a4fe4ebb6"} Jun 11 12:38:52.512059 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:38:52.511851 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf6a7ea6f46a1f0fba31a7c890fdad82a308928a515c9747d3c64b9a4fe4ebb6" Jun 11 12:39:00.206974 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.206930 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv"] Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207352 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="extract" Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207371 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="extract" Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207387 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="util" Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207395 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="util" Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207415 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="pull" Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207422 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="pull" Jun 11 12:39:00.207495 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.207497 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bf90b94-3920-4b50-9295-b23a35639def" containerName="extract" Jun 11 12:39:00.210170 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.210146 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.214934 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.214905 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 12:39:00.215119 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.214967 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 12:39:00.215184 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.215155 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pn74x\"" Jun 11 12:39:00.216529 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.216478 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 12:39:00.216669 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.216618 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 12:39:00.221937 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.221908 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-manifests\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.222046 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.221954 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vsw8\" (UniqueName: \"kubernetes.io/projected/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-kube-api-access-5vsw8\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.222133 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.222057 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-tmp\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.222133 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.222085 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.222133 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.222119 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.229449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.229419 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv"] Jun 11 12:39:00.322862 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.322820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-tmp\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.322862 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.322863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.323130 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.322893 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.323130 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.322926 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-manifests\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.323130 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.322948 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsw8\" (UniqueName: \"kubernetes.io/projected/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-kube-api-access-5vsw8\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.323376 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.323351 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-manifests\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.325324 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.325294 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-tmp\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.325582 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.325561 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.325693 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.325650 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.355837 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.355795 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vsw8\" (UniqueName: \"kubernetes.io/projected/303a7ef0-bbf7-4e26-9ffb-96d7409066bc-kube-api-access-5vsw8\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-sn8fv\" (UID: \"303a7ef0-bbf7-4e26-9ffb-96d7409066bc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.521853 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.521753 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:00.667824 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:00.667787 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv"] Jun 11 12:39:00.672618 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:00.672588 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303a7ef0_bbf7_4e26_9ffb_96d7409066bc.slice/crio-e9155e0dbed7ba2a29294a2b2acf30c962fe5ff09c6830aeb1c2590a1d031f6f WatchSource:0}: Error finding container e9155e0dbed7ba2a29294a2b2acf30c962fe5ff09c6830aeb1c2590a1d031f6f: Status 404 returned error can't find the container with id e9155e0dbed7ba2a29294a2b2acf30c962fe5ff09c6830aeb1c2590a1d031f6f Jun 11 12:39:01.552023 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:01.551977 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" event={"ID":"303a7ef0-bbf7-4e26-9ffb-96d7409066bc","Type":"ContainerStarted","Data":"e9155e0dbed7ba2a29294a2b2acf30c962fe5ff09c6830aeb1c2590a1d031f6f"} Jun 11 12:39:04.569888 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:04.569850 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" event={"ID":"303a7ef0-bbf7-4e26-9ffb-96d7409066bc","Type":"ContainerStarted","Data":"5c5bb7731c6499477b8fe0f322be98cd96d91fb89f214bc434039443e7d0aa33"} Jun 11 12:39:05.575527 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:05.575488 2569 generic.go:356] "Generic (PLEG): container finished" podID="303a7ef0-bbf7-4e26-9ffb-96d7409066bc" containerID="5c5bb7731c6499477b8fe0f322be98cd96d91fb89f214bc434039443e7d0aa33" exitCode=0 Jun 11 12:39:05.575527 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:05.575530 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" event={"ID":"303a7ef0-bbf7-4e26-9ffb-96d7409066bc","Type":"ContainerDied","Data":"5c5bb7731c6499477b8fe0f322be98cd96d91fb89f214bc434039443e7d0aa33"} Jun 11 12:39:06.581379 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:06.581338 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" event={"ID":"303a7ef0-bbf7-4e26-9ffb-96d7409066bc","Type":"ContainerStarted","Data":"d8aa01ff0442e316adae4b72fbb9a00356b9500f2c75f31419d2000487ee7539"} Jun 11 12:39:06.581815 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:06.581487 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:06.614423 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:06.614345 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" podStartSLOduration=2.1301379320000002 podStartE2EDuration="6.614328844s" totalImagesPullingTime="3.442964327s" totalInitContainerRuntime="1.041226585s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:06.612474793 +0000 UTC m=+1075.066085904" watchObservedRunningTime="2026-06-11 12:39:06.614328844 +0000 UTC m=+1075.067939940" Jun 11 12:39:17.588396 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:17.588357 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-sn8fv" Jun 11 12:39:19.943614 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.943580 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg"] Jun 11 12:39:19.952121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.952086 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:19.954957 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.954931 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 12:39:19.959444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.959413 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6d8vq\"" Jun 11 12:39:19.961424 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.960021 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 12:39:19.972878 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.972842 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg"] Jun 11 12:39:19.973158 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.973135 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:19.973235 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.973174 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:19.973235 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.973192 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4zvd\" (UniqueName: \"kubernetes.io/projected/d9a85733-1f09-4e00-b5df-971a54f0ffac-kube-api-access-l4zvd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:19.975976 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.975927 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7"] Jun 11 12:39:19.979589 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.979563 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:19.982363 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.982324 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 12:39:19.983190 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.983153 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 12:39:19.983318 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.983294 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tg6hq\"" Jun 11 12:39:19.999120 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:19.999092 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7"] Jun 11 12:39:20.074412 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074368 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-tls-certs\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.074658 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074506 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-tmp\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.074658 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.074658 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074587 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssgt5\" (UniqueName: \"kubernetes.io/projected/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-kube-api-access-ssgt5\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.074838 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.074838 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4zvd\" (UniqueName: \"kubernetes.io/projected/d9a85733-1f09-4e00-b5df-971a54f0ffac-kube-api-access-l4zvd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.074992 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.074958 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.075048 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.075031 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.097289 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.097260 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4zvd\" (UniqueName: \"kubernetes.io/projected/d9a85733-1f09-4e00-b5df-971a54f0ffac-kube-api-access-l4zvd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.175520 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.175482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-tls-certs\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.175520 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.175522 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-tmp\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.175755 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.175575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssgt5\" (UniqueName: \"kubernetes.io/projected/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-kube-api-access-ssgt5\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.177775 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.177744 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-tmp\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.177987 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.177968 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-tls-certs\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.235204 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.235122 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssgt5\" (UniqueName: \"kubernetes.io/projected/74d20a1d-80e9-4973-9cba-2e0baa5f25a7-kube-api-access-ssgt5\") pod \"kube-auth-proxy-6d45d4496f-ss9m7\" (UID: \"74d20a1d-80e9-4973-9cba-2e0baa5f25a7\") " pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.267084 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.267049 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:20.289650 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.289612 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" Jun 11 12:39:20.437140 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.437103 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg"] Jun 11 12:39:20.438951 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:20.438925 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a85733_1f09_4e00_b5df_971a54f0ffac.slice/crio-528db74234235eb885500b6678aa9489077e1cbd94480bd09b2c0b62a4659720 WatchSource:0}: Error finding container 528db74234235eb885500b6678aa9489077e1cbd94480bd09b2c0b62a4659720: Status 404 returned error can't find the container with id 528db74234235eb885500b6678aa9489077e1cbd94480bd09b2c0b62a4659720 Jun 11 12:39:20.452747 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.452649 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7"] Jun 11 12:39:20.455433 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.455410 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bhvn4"] Jun 11 12:39:20.457127 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:20.457101 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d20a1d_80e9_4973_9cba_2e0baa5f25a7.slice/crio-72735ae3185cc1be337952da6ab9e364caf7896c319301cd00bb500e7fa1340e WatchSource:0}: Error finding container 72735ae3185cc1be337952da6ab9e364caf7896c319301cd00bb500e7fa1340e: Status 404 returned error can't find the container with id 72735ae3185cc1be337952da6ab9e364caf7896c319301cd00bb500e7fa1340e Jun 11 12:39:20.460958 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.460939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:20.464502 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.464480 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 12:39:20.464634 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.464616 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2dg7m\"" Jun 11 12:39:20.477883 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.477854 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bhvn4"] Jun 11 12:39:20.580099 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.580063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kwt\" (UniqueName: \"kubernetes.io/projected/091b3b06-e0f1-4c4e-bc01-177403a4a274-kube-api-access-z8kwt\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:20.580287 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.580193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091b3b06-e0f1-4c4e-bc01-177403a4a274-cert\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:20.644768 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.644730 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" event={"ID":"74d20a1d-80e9-4973-9cba-2e0baa5f25a7","Type":"ContainerStarted","Data":"72735ae3185cc1be337952da6ab9e364caf7896c319301cd00bb500e7fa1340e"} Jun 11 12:39:20.646258 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.646230 2569 generic.go:356] "Generic (PLEG): container finished" podID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerID="168436cf2c49d1252ea12fece5b2f44073ab0d6b044ac3c62ab61ed701d0cc66" exitCode=0 Jun 11 12:39:20.646379 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.646314 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" event={"ID":"d9a85733-1f09-4e00-b5df-971a54f0ffac","Type":"ContainerDied","Data":"168436cf2c49d1252ea12fece5b2f44073ab0d6b044ac3c62ab61ed701d0cc66"} Jun 11 12:39:20.646379 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.646364 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" event={"ID":"d9a85733-1f09-4e00-b5df-971a54f0ffac","Type":"ContainerStarted","Data":"528db74234235eb885500b6678aa9489077e1cbd94480bd09b2c0b62a4659720"} Jun 11 12:39:20.680802 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.680759 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kwt\" (UniqueName: \"kubernetes.io/projected/091b3b06-e0f1-4c4e-bc01-177403a4a274-kube-api-access-z8kwt\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:20.680984 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.680878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091b3b06-e0f1-4c4e-bc01-177403a4a274-cert\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:20.681036 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:39:20.681017 2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 12:39:20.681083 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:39:20.681076 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091b3b06-e0f1-4c4e-bc01-177403a4a274-cert podName:091b3b06-e0f1-4c4e-bc01-177403a4a274 nodeName:}" failed. No retries permitted until 2026-06-11 12:39:21.181061284 +0000 UTC m=+1089.634672363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/091b3b06-e0f1-4c4e-bc01-177403a4a274-cert") pod "odh-model-controller-6dc94f689f-bhvn4" (UID: "091b3b06-e0f1-4c4e-bc01-177403a4a274") : secret "odh-model-controller-webhook-cert" not found Jun 11 12:39:20.703201 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:20.703168 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kwt\" (UniqueName: \"kubernetes.io/projected/091b3b06-e0f1-4c4e-bc01-177403a4a274-kube-api-access-z8kwt\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:21.186091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.186045 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091b3b06-e0f1-4c4e-bc01-177403a4a274-cert\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:21.191239 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.189445 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091b3b06-e0f1-4c4e-bc01-177403a4a274-cert\") pod \"odh-model-controller-6dc94f689f-bhvn4\" (UID: \"091b3b06-e0f1-4c4e-bc01-177403a4a274\") " pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:21.386676 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.386634 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:21.504656 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.504606 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7kwmw"] Jun 11 12:39:21.508786 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.508733 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.513497 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.513465 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 12:39:21.529763 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.529604 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7kwmw"] Jun 11 12:39:21.590882 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.590839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b82f85-981b-4729-8cb4-aba01ce78636-tls-certs\") pod \"model-serving-api-5dd488fc48-7kwmw\" (UID: \"89b82f85-981b-4729-8cb4-aba01ce78636\") " pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.590882 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.590888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4w5h\" (UniqueName: \"kubernetes.io/projected/89b82f85-981b-4729-8cb4-aba01ce78636-kube-api-access-s4w5h\") pod \"model-serving-api-5dd488fc48-7kwmw\" (UID: \"89b82f85-981b-4729-8cb4-aba01ce78636\") " pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.596561 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.596513 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bhvn4"] Jun 11 12:39:21.599092 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:21.599023 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091b3b06_e0f1_4c4e_bc01_177403a4a274.slice/crio-d431158e621ec257f08ae6e00052730fe4112af03f060702d5d0ab79573b8c2f WatchSource:0}: Error finding container d431158e621ec257f08ae6e00052730fe4112af03f060702d5d0ab79573b8c2f: Status 404 returned error can't find the container with id d431158e621ec257f08ae6e00052730fe4112af03f060702d5d0ab79573b8c2f Jun 11 12:39:21.652961 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.652920 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" event={"ID":"091b3b06-e0f1-4c4e-bc01-177403a4a274","Type":"ContainerStarted","Data":"d431158e621ec257f08ae6e00052730fe4112af03f060702d5d0ab79573b8c2f"} Jun 11 12:39:21.691589 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.691487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b82f85-981b-4729-8cb4-aba01ce78636-tls-certs\") pod \"model-serving-api-5dd488fc48-7kwmw\" (UID: \"89b82f85-981b-4729-8cb4-aba01ce78636\") " pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.691785 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.691604 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4w5h\" (UniqueName: \"kubernetes.io/projected/89b82f85-981b-4729-8cb4-aba01ce78636-kube-api-access-s4w5h\") pod \"model-serving-api-5dd488fc48-7kwmw\" (UID: \"89b82f85-981b-4729-8cb4-aba01ce78636\") " pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.694894 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.694855 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b82f85-981b-4729-8cb4-aba01ce78636-tls-certs\") pod \"model-serving-api-5dd488fc48-7kwmw\" (UID: \"89b82f85-981b-4729-8cb4-aba01ce78636\") " pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.706209 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.706178 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4w5h\" (UniqueName: \"kubernetes.io/projected/89b82f85-981b-4729-8cb4-aba01ce78636-kube-api-access-s4w5h\") pod \"model-serving-api-5dd488fc48-7kwmw\" (UID: \"89b82f85-981b-4729-8cb4-aba01ce78636\") " pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:21.824398 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:21.824318 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:22.678855 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:22.678830 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7kwmw"] Jun 11 12:39:23.390504 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:23.390461 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b82f85_981b_4729_8cb4_aba01ce78636.slice/crio-d52f12fe5a6b9651424a27c948e2feb34b410f0032db57024c6bd63923ba264e WatchSource:0}: Error finding container d52f12fe5a6b9651424a27c948e2feb34b410f0032db57024c6bd63923ba264e: Status 404 returned error can't find the container with id d52f12fe5a6b9651424a27c948e2feb34b410f0032db57024c6bd63923ba264e Jun 11 12:39:23.668256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:23.668215 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" event={"ID":"74d20a1d-80e9-4973-9cba-2e0baa5f25a7","Type":"ContainerStarted","Data":"4bb52a451324fe0a74e3981e5ca46661d7a1ae4f6b37b546c13107cb873c5fa0"} Jun 11 12:39:23.669636 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:23.669602 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" event={"ID":"89b82f85-981b-4729-8cb4-aba01ce78636","Type":"ContainerStarted","Data":"d52f12fe5a6b9651424a27c948e2feb34b410f0032db57024c6bd63923ba264e"} Jun 11 12:39:23.688451 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:23.688394 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d45d4496f-ss9m7" podStartSLOduration=1.700543523 podStartE2EDuration="4.688371634s" totalImagesPullingTime="2.987828111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:23.687609922 +0000 UTC m=+1092.141221019" watchObservedRunningTime="2026-06-11 12:39:23.688371634 +0000 UTC m=+1092.141982733" Jun 11 12:39:25.682255 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:25.682216 2569 generic.go:356] "Generic (PLEG): container finished" podID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerID="2a71353d06b68590fb25a0b6ead65b6a06022004f040b15ddee394ce6efe7495" exitCode=0 Jun 11 12:39:25.682764 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:25.682306 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" event={"ID":"d9a85733-1f09-4e00-b5df-971a54f0ffac","Type":"ContainerDied","Data":"2a71353d06b68590fb25a0b6ead65b6a06022004f040b15ddee394ce6efe7495"} Jun 11 12:39:25.684081 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:25.684056 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" event={"ID":"091b3b06-e0f1-4c4e-bc01-177403a4a274","Type":"ContainerStarted","Data":"dde010db2bb3248c38c7e27d22f39a273ad9263a20b9d4e58d3a0eeca193be7f"} Jun 11 12:39:25.684225 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:25.684206 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:25.719466 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:25.719405 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" podStartSLOduration=2.382150331 podStartE2EDuration="5.719381806s" totalImagesPullingTime="3.337231475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:25.718300254 +0000 UTC m=+1094.171911351" watchObservedRunningTime="2026-06-11 12:39:25.719381806 +0000 UTC m=+1094.172992903" Jun 11 12:39:26.691930 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:26.691897 2569 generic.go:356] "Generic (PLEG): container finished" podID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerID="a77c8db24fbaf56fcadadd0e96b905b9244078c16af1fba5c65d7fbb21cd3f71" exitCode=0 Jun 11 12:39:26.692349 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:26.691973 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" event={"ID":"d9a85733-1f09-4e00-b5df-971a54f0ffac","Type":"ContainerDied","Data":"a77c8db24fbaf56fcadadd0e96b905b9244078c16af1fba5c65d7fbb21cd3f71"} Jun 11 12:39:26.693638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:26.693609 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" event={"ID":"89b82f85-981b-4729-8cb4-aba01ce78636","Type":"ContainerStarted","Data":"782280c5aac9fd59271a6b354d8f05ca66d66e55d77f834ea238683a4cd84793"} Jun 11 12:39:26.693753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:26.693662 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:26.748775 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:26.748717 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" podStartSLOduration=3.1728646879999998 podStartE2EDuration="5.748701984s" totalImagesPullingTime="2.575837296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:26.746234353 +0000 UTC m=+1095.199845461" watchObservedRunningTime="2026-06-11 12:39:26.748701984 +0000 UTC m=+1095.202313080" Jun 11 12:39:27.825311 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.825280 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:27.948499 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.948416 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-util\") pod \"d9a85733-1f09-4e00-b5df-971a54f0ffac\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " Jun 11 12:39:27.948668 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.948502 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4zvd\" (UniqueName: \"kubernetes.io/projected/d9a85733-1f09-4e00-b5df-971a54f0ffac-kube-api-access-l4zvd\") pod \"d9a85733-1f09-4e00-b5df-971a54f0ffac\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " Jun 11 12:39:27.948668 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.948557 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-bundle\") pod \"d9a85733-1f09-4e00-b5df-971a54f0ffac\" (UID: \"d9a85733-1f09-4e00-b5df-971a54f0ffac\") " Jun 11 12:39:27.949450 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.949418 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-bundle" (OuterVolumeSpecName: "bundle") pod "d9a85733-1f09-4e00-b5df-971a54f0ffac" (UID: "d9a85733-1f09-4e00-b5df-971a54f0ffac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:39:27.950858 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.950829 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a85733-1f09-4e00-b5df-971a54f0ffac-kube-api-access-l4zvd" (OuterVolumeSpecName: "kube-api-access-l4zvd") pod "d9a85733-1f09-4e00-b5df-971a54f0ffac" (UID: "d9a85733-1f09-4e00-b5df-971a54f0ffac"). InnerVolumeSpecName "kube-api-access-l4zvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:39:27.954594 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:27.954564 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-util" (OuterVolumeSpecName: "util") pod "d9a85733-1f09-4e00-b5df-971a54f0ffac" (UID: "d9a85733-1f09-4e00-b5df-971a54f0ffac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:39:28.050137 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:28.050094 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4zvd\" (UniqueName: \"kubernetes.io/projected/d9a85733-1f09-4e00-b5df-971a54f0ffac-kube-api-access-l4zvd\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:39:28.050137 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:28.050129 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:39:28.050137 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:28.050142 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a85733-1f09-4e00-b5df-971a54f0ffac-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:39:28.703827 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:28.703794 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" event={"ID":"d9a85733-1f09-4e00-b5df-971a54f0ffac","Type":"ContainerDied","Data":"528db74234235eb885500b6678aa9489077e1cbd94480bd09b2c0b62a4659720"} Jun 11 12:39:28.703827 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:28.703821 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06d4ztg" Jun 11 12:39:28.704026 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:28.703840 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="528db74234235eb885500b6678aa9489077e1cbd94480bd09b2c0b62a4659720" Jun 11 12:39:30.659729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.659688 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-h55kn"] Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660016 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="util" Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660027 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="util" Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660038 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="extract" Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660043 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="extract" Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660052 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="pull" Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660057 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="pull" Jun 11 12:39:30.660116 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.660106 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a85733-1f09-4e00-b5df-971a54f0ffac" containerName="extract" Jun 11 12:39:30.666483 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.666458 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.671552 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.671516 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4b9q7\"" Jun 11 12:39:30.671822 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.671801 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 12:39:30.687143 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.687112 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw"] Jun 11 12:39:30.691177 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.691155 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:30.696224 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.696195 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 12:39:30.696512 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.696492 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-llhlv\"" Jun 11 12:39:30.699229 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.699204 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-h55kn"] Jun 11 12:39:30.702094 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.702069 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw"] Jun 11 12:39:30.772555 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.772500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxvm\" (UniqueName: \"kubernetes.io/projected/8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0-kube-api-access-kzxvm\") pod \"kserve-controller-manager-69fc866d76-h55kn\" (UID: \"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.772729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.772622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bac8b8e8-dc03-4434-8ce4-18f64a52d065-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:30.772729 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.772693 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549p4\" (UniqueName: \"kubernetes.io/projected/bac8b8e8-dc03-4434-8ce4-18f64a52d065-kube-api-access-549p4\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:30.772815 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.772773 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0-cert\") pod \"kserve-controller-manager-69fc866d76-h55kn\" (UID: \"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.874213 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.874175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549p4\" (UniqueName: \"kubernetes.io/projected/bac8b8e8-dc03-4434-8ce4-18f64a52d065-kube-api-access-549p4\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:30.874364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.874230 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0-cert\") pod \"kserve-controller-manager-69fc866d76-h55kn\" (UID: \"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.874364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.874254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxvm\" (UniqueName: \"kubernetes.io/projected/8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0-kube-api-access-kzxvm\") pod \"kserve-controller-manager-69fc866d76-h55kn\" (UID: \"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.874364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.874288 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bac8b8e8-dc03-4434-8ce4-18f64a52d065-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:30.874569 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:39:30.874520 2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 11 12:39:30.874623 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:39:30.874612 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bac8b8e8-dc03-4434-8ce4-18f64a52d065-cert podName:bac8b8e8-dc03-4434-8ce4-18f64a52d065 nodeName:}" failed. No retries permitted until 2026-06-11 12:39:31.374591654 +0000 UTC m=+1099.828202738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bac8b8e8-dc03-4434-8ce4-18f64a52d065-cert") pod "llmisvc-controller-manager-864bfd7bc9-w9rqw" (UID: "bac8b8e8-dc03-4434-8ce4-18f64a52d065") : secret "llmisvc-webhook-server-cert" not found Jun 11 12:39:30.876717 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.876689 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0-cert\") pod \"kserve-controller-manager-69fc866d76-h55kn\" (UID: \"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.885767 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.885738 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-549p4\" (UniqueName: \"kubernetes.io/projected/bac8b8e8-dc03-4434-8ce4-18f64a52d065-kube-api-access-549p4\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:30.886204 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.886187 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxvm\" (UniqueName: \"kubernetes.io/projected/8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0-kube-api-access-kzxvm\") pod \"kserve-controller-manager-69fc866d76-h55kn\" (UID: \"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:30.976802 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:30.976704 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:31.126784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:31.126755 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-h55kn"] Jun 11 12:39:31.129047 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:31.129019 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de8a99e_b9a0_4df5_b62a_1ed91e49e4b0.slice/crio-e99293cde1c6d735a8a3914d119a94e12c1e586cc42cc5b05388fdbd7f466972 WatchSource:0}: Error finding container e99293cde1c6d735a8a3914d119a94e12c1e586cc42cc5b05388fdbd7f466972: Status 404 returned error can't find the container with id e99293cde1c6d735a8a3914d119a94e12c1e586cc42cc5b05388fdbd7f466972 Jun 11 12:39:31.378629 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:31.378500 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bac8b8e8-dc03-4434-8ce4-18f64a52d065-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:31.380963 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:31.380940 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bac8b8e8-dc03-4434-8ce4-18f64a52d065-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-w9rqw\" (UID: \"bac8b8e8-dc03-4434-8ce4-18f64a52d065\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:31.603192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:31.603154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:31.721482 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:31.721442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" event={"ID":"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0","Type":"ContainerStarted","Data":"e99293cde1c6d735a8a3914d119a94e12c1e586cc42cc5b05388fdbd7f466972"} Jun 11 12:39:31.771290 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:31.771258 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw"] Jun 11 12:39:31.773262 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:31.773232 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbac8b8e8_dc03_4434_8ce4_18f64a52d065.slice/crio-6f9190c6e5a3f617b758ee68833f86e4c3f8d7375049addf8d70c0cfdbc7094c WatchSource:0}: Error finding container 6f9190c6e5a3f617b758ee68833f86e4c3f8d7375049addf8d70c0cfdbc7094c: Status 404 returned error can't find the container with id 6f9190c6e5a3f617b758ee68833f86e4c3f8d7375049addf8d70c0cfdbc7094c Jun 11 12:39:32.727030 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:32.726998 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" event={"ID":"bac8b8e8-dc03-4434-8ce4-18f64a52d065","Type":"ContainerStarted","Data":"6f9190c6e5a3f617b758ee68833f86e4c3f8d7375049addf8d70c0cfdbc7094c"} Jun 11 12:39:34.634754 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.634708 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759"] Jun 11 12:39:34.638468 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.638447 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.644803 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.644768 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6d8vq\"" Jun 11 12:39:34.644988 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.644821 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 12:39:34.646128 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.646106 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 12:39:34.709557 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.709511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.709760 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.709580 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.709760 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.709709 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2cb\" (UniqueName: \"kubernetes.io/projected/76a35c4b-5c67-4e5f-a923-fe6f320a207f-kube-api-access-lj2cb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.716410 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.716374 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759"] Jun 11 12:39:34.740594 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.740530 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" event={"ID":"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0","Type":"ContainerStarted","Data":"0a9c8b2aec67fabb1c6bb8fe9e0789ae4c0aa0b653130f5fa0df82645c5cbdce"} Jun 11 12:39:34.740772 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.740749 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:39:34.810423 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.810384 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2cb\" (UniqueName: \"kubernetes.io/projected/76a35c4b-5c67-4e5f-a923-fe6f320a207f-kube-api-access-lj2cb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.810688 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.810452 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.810688 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.810494 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.811026 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.810958 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.811123 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.811069 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.875706 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.875665 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2cb\" (UniqueName: \"kubernetes.io/projected/76a35c4b-5c67-4e5f-a923-fe6f320a207f-kube-api-access-lj2cb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:34.885818 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.885713 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" podStartSLOduration=1.9533092920000001 podStartE2EDuration="4.885688912s" totalImagesPullingTime="2.93237962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:34.884007987 +0000 UTC m=+1103.337619088" watchObservedRunningTime="2026-06-11 12:39:34.885688912 +0000 UTC m=+1103.339300013" Jun 11 12:39:34.948073 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:34.948033 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:35.534637 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.534595 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759"] Jun 11 12:39:35.539065 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:35.539034 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a35c4b_5c67_4e5f_a923_fe6f320a207f.slice/crio-01b62674a8aac6d34e1d4573fea7303ab612cbb475ae480e3ef300701e07382f WatchSource:0}: Error finding container 01b62674a8aac6d34e1d4573fea7303ab612cbb475ae480e3ef300701e07382f: Status 404 returned error can't find the container with id 01b62674a8aac6d34e1d4573fea7303ab612cbb475ae480e3ef300701e07382f Jun 11 12:39:35.747275 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.747229 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" event={"ID":"bac8b8e8-dc03-4434-8ce4-18f64a52d065","Type":"ContainerStarted","Data":"d0a19dd91e64b51def75b43efa63881960ba5fea89e3c29eadd181b03624b8e8"} Jun 11 12:39:35.747776 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.747447 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:39:35.749160 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.749129 2569 generic.go:356] "Generic (PLEG): container finished" podID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerID="836953e2afd33a4225a556b35f4b26600bcfe94ecebe1900929c287d620afcbb" exitCode=0 Jun 11 12:39:35.749319 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.749215 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" event={"ID":"76a35c4b-5c67-4e5f-a923-fe6f320a207f","Type":"ContainerDied","Data":"836953e2afd33a4225a556b35f4b26600bcfe94ecebe1900929c287d620afcbb"} Jun 11 12:39:35.749319 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.749267 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" event={"ID":"76a35c4b-5c67-4e5f-a923-fe6f320a207f","Type":"ContainerStarted","Data":"01b62674a8aac6d34e1d4573fea7303ab612cbb475ae480e3ef300701e07382f"} Jun 11 12:39:35.803187 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:35.803072 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" podStartSLOduration=2.217192036 podStartE2EDuration="5.803051102s" totalImagesPullingTime="3.585859066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:35.801952475 +0000 UTC m=+1104.255563574" watchObservedRunningTime="2026-06-11 12:39:35.803051102 +0000 UTC m=+1104.256662199" Jun 11 12:39:36.696648 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:36.696612 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-bhvn4" Jun 11 12:39:37.701594 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:37.701565 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-7kwmw" Jun 11 12:39:37.764249 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:37.764212 2569 generic.go:356] "Generic (PLEG): container finished" podID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerID="b814f6d221dbbdb73ecf19fc9cff1662996119b8909727f97cae06d25b5225fc" exitCode=0 Jun 11 12:39:37.764465 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:37.764292 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" event={"ID":"76a35c4b-5c67-4e5f-a923-fe6f320a207f","Type":"ContainerDied","Data":"b814f6d221dbbdb73ecf19fc9cff1662996119b8909727f97cae06d25b5225fc"} Jun 11 12:39:38.772009 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:38.771971 2569 generic.go:356] "Generic (PLEG): container finished" podID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerID="a917139fa07d22932d3972ba4cd2e78b4016b3dff3587d9112584c0318dacb8f" exitCode=0 Jun 11 12:39:38.772494 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:38.772053 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" event={"ID":"76a35c4b-5c67-4e5f-a923-fe6f320a207f","Type":"ContainerDied","Data":"a917139fa07d22932d3972ba4cd2e78b4016b3dff3587d9112584c0318dacb8f"} Jun 11 12:39:39.080872 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.080774 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-njc5n"] Jun 11 12:39:39.097736 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.097699 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.103225 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.103198 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 12:39:39.104434 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.104404 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 12:39:39.104597 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.104462 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-8rfc4\"" Jun 11 12:39:39.106292 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.106268 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-njc5n"] Jun 11 12:39:39.248509 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.248469 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2g6k\" (UniqueName: \"kubernetes.io/projected/4784790b-e108-4f95-9376-5ccf3da9a48e-kube-api-access-z2g6k\") pod \"servicemesh-operator3-57f65f65fb-njc5n\" (UID: \"4784790b-e108-4f95-9376-5ccf3da9a48e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.248723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.248564 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4784790b-e108-4f95-9376-5ccf3da9a48e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-njc5n\" (UID: \"4784790b-e108-4f95-9376-5ccf3da9a48e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.349696 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.349598 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2g6k\" (UniqueName: \"kubernetes.io/projected/4784790b-e108-4f95-9376-5ccf3da9a48e-kube-api-access-z2g6k\") pod \"servicemesh-operator3-57f65f65fb-njc5n\" (UID: \"4784790b-e108-4f95-9376-5ccf3da9a48e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.349887 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.349703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4784790b-e108-4f95-9376-5ccf3da9a48e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-njc5n\" (UID: \"4784790b-e108-4f95-9376-5ccf3da9a48e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.353465 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.353427 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4784790b-e108-4f95-9376-5ccf3da9a48e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-njc5n\" (UID: \"4784790b-e108-4f95-9376-5ccf3da9a48e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.372634 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.372604 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2g6k\" (UniqueName: \"kubernetes.io/projected/4784790b-e108-4f95-9376-5ccf3da9a48e-kube-api-access-z2g6k\") pod \"servicemesh-operator3-57f65f65fb-njc5n\" (UID: \"4784790b-e108-4f95-9376-5ccf3da9a48e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.408653 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.408617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:39.619791 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:39.619751 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4784790b_e108_4f95_9376_5ccf3da9a48e.slice/crio-c016d97a775346a8db4f265c1583a3782ba3e3e679f9373235436898804a6f5e WatchSource:0}: Error finding container c016d97a775346a8db4f265c1583a3782ba3e3e679f9373235436898804a6f5e: Status 404 returned error can't find the container with id c016d97a775346a8db4f265c1583a3782ba3e3e679f9373235436898804a6f5e Jun 11 12:39:39.622699 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.622648 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-njc5n"] Jun 11 12:39:39.779380 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.779338 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" event={"ID":"4784790b-e108-4f95-9376-5ccf3da9a48e","Type":"ContainerStarted","Data":"c016d97a775346a8db4f265c1583a3782ba3e3e679f9373235436898804a6f5e"} Jun 11 12:39:39.929796 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:39.929757 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:40.055317 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.055279 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-util\") pod \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " Jun 11 12:39:40.055601 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.055339 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-bundle\") pod \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " Jun 11 12:39:40.055601 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.055394 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj2cb\" (UniqueName: \"kubernetes.io/projected/76a35c4b-5c67-4e5f-a923-fe6f320a207f-kube-api-access-lj2cb\") pod \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\" (UID: \"76a35c4b-5c67-4e5f-a923-fe6f320a207f\") " Jun 11 12:39:40.056264 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.056230 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-bundle" (OuterVolumeSpecName: "bundle") pod "76a35c4b-5c67-4e5f-a923-fe6f320a207f" (UID: "76a35c4b-5c67-4e5f-a923-fe6f320a207f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:39:40.057599 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.057564 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a35c4b-5c67-4e5f-a923-fe6f320a207f-kube-api-access-lj2cb" (OuterVolumeSpecName: "kube-api-access-lj2cb") pod "76a35c4b-5c67-4e5f-a923-fe6f320a207f" (UID: "76a35c4b-5c67-4e5f-a923-fe6f320a207f"). InnerVolumeSpecName "kube-api-access-lj2cb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:39:40.063463 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.063427 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-util" (OuterVolumeSpecName: "util") pod "76a35c4b-5c67-4e5f-a923-fe6f320a207f" (UID: "76a35c4b-5c67-4e5f-a923-fe6f320a207f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:39:40.156308 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.156200 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:39:40.156308 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.156238 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a35c4b-5c67-4e5f-a923-fe6f320a207f-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:39:40.156308 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.156257 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj2cb\" (UniqueName: \"kubernetes.io/projected/76a35c4b-5c67-4e5f-a923-fe6f320a207f-kube-api-access-lj2cb\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:39:40.786403 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.786369 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" event={"ID":"76a35c4b-5c67-4e5f-a923-fe6f320a207f","Type":"ContainerDied","Data":"01b62674a8aac6d34e1d4573fea7303ab612cbb475ae480e3ef300701e07382f"} Jun 11 12:39:40.786902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.786423 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01b62674a8aac6d34e1d4573fea7303ab612cbb475ae480e3ef300701e07382f" Jun 11 12:39:40.786902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:40.786376 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5s759" Jun 11 12:39:45.814391 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:45.814350 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" event={"ID":"4784790b-e108-4f95-9376-5ccf3da9a48e","Type":"ContainerStarted","Data":"dcd928ff33b4ca7195dafcbf47a24e3eefacc19ba350703b41dbbcf002b8c2c1"} Jun 11 12:39:45.814818 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:45.814416 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:45.838036 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:45.837978 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" podStartSLOduration=1.623038132 podStartE2EDuration="6.837956385s" totalImagesPullingTime="5.214918253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:45.835736078 +0000 UTC m=+1114.289347187" watchObservedRunningTime="2026-06-11 12:39:45.837956385 +0000 UTC m=+1114.291567485" Jun 11 12:39:50.225391 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225353 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz"] Jun 11 12:39:50.225869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225816 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="pull" Jun 11 12:39:50.225869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225832 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="pull" Jun 11 12:39:50.225869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225846 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="extract" Jun 11 12:39:50.225869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225854 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="extract" Jun 11 12:39:50.225869 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225870 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="util" Jun 11 12:39:50.226033 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225876 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="util" Jun 11 12:39:50.226033 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.225928 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a35c4b-5c67-4e5f-a923-fe6f320a207f" containerName="extract" Jun 11 12:39:50.228333 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.228313 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.231213 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.231180 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 12:39:50.231334 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.231265 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p99jc\"" Jun 11 12:39:50.238978 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.238948 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz"] Jun 11 12:39:50.346030 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.345979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c5810227-19a6-4702-89d9-ed349649c2c9-redirect-config\") pod \"dashboard-redirect-5ccf4c4b56-7zkrz\" (UID: \"c5810227-19a6-4702-89d9-ed349649c2c9\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.346030 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.346036 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwsnm\" (UniqueName: \"kubernetes.io/projected/c5810227-19a6-4702-89d9-ed349649c2c9-kube-api-access-hwsnm\") pod \"dashboard-redirect-5ccf4c4b56-7zkrz\" (UID: \"c5810227-19a6-4702-89d9-ed349649c2c9\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.446731 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.446687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c5810227-19a6-4702-89d9-ed349649c2c9-redirect-config\") pod \"dashboard-redirect-5ccf4c4b56-7zkrz\" (UID: \"c5810227-19a6-4702-89d9-ed349649c2c9\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.446731 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.446734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwsnm\" (UniqueName: \"kubernetes.io/projected/c5810227-19a6-4702-89d9-ed349649c2c9-kube-api-access-hwsnm\") pod \"dashboard-redirect-5ccf4c4b56-7zkrz\" (UID: \"c5810227-19a6-4702-89d9-ed349649c2c9\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.447682 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.447646 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c5810227-19a6-4702-89d9-ed349649c2c9-redirect-config\") pod \"dashboard-redirect-5ccf4c4b56-7zkrz\" (UID: \"c5810227-19a6-4702-89d9-ed349649c2c9\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.458890 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.458865 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwsnm\" (UniqueName: \"kubernetes.io/projected/c5810227-19a6-4702-89d9-ed349649c2c9-kube-api-access-hwsnm\") pod \"dashboard-redirect-5ccf4c4b56-7zkrz\" (UID: \"c5810227-19a6-4702-89d9-ed349649c2c9\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.540733 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.540613 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" Jun 11 12:39:50.688275 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.688248 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz"] Jun 11 12:39:50.690207 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:39:50.690178 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5810227_19a6_4702_89d9_ed349649c2c9.slice/crio-eaef233a6c4f7ad522a8799e53a5fca83569582c11ec1efbd0b767802b043c28 WatchSource:0}: Error finding container eaef233a6c4f7ad522a8799e53a5fca83569582c11ec1efbd0b767802b043c28: Status 404 returned error can't find the container with id eaef233a6c4f7ad522a8799e53a5fca83569582c11ec1efbd0b767802b043c28 Jun 11 12:39:50.845875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:50.845786 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" event={"ID":"c5810227-19a6-4702-89d9-ed349649c2c9","Type":"ContainerStarted","Data":"eaef233a6c4f7ad522a8799e53a5fca83569582c11ec1efbd0b767802b043c28"} Jun 11 12:39:56.821207 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:56.821172 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-njc5n" Jun 11 12:39:56.880812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:56.880763 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" event={"ID":"c5810227-19a6-4702-89d9-ed349649c2c9","Type":"ContainerStarted","Data":"ede2cebf124b63450de684f0290120f8c9190a48fd6db623c44d40cc1ada929c"} Jun 11 12:39:56.900274 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:39:56.900214 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5ccf4c4b56-7zkrz" podStartSLOduration=1.6024926449999999 podStartE2EDuration="6.90019288s" totalImagesPullingTime="5.297700235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:56.899842595 +0000 UTC m=+1125.353453705" watchObservedRunningTime="2026-06-11 12:39:56.90019288 +0000 UTC m=+1125.353803981" Jun 11 12:40:05.755376 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:05.755339 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:40:06.739484 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.739445 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp"] Jun 11 12:40:06.746371 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.746343 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.749154 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.749127 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 12:40:06.749320 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.749130 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 12:40:06.749407 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.749315 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xn4vb\"" Jun 11 12:40:06.749407 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.749352 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 12:40:06.749517 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.749489 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 12:40:06.756188 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.756157 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-w9rqw" Jun 11 12:40:06.757285 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.757260 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp"] Jun 11 12:40:06.782605 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782571 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf1c862e-1cba-4409-8793-913fac451f97-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.782605 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782610 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.782846 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782649 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.782846 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782677 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf1c862e-1cba-4409-8793-913fac451f97-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.782846 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf1c862e-1cba-4409-8793-913fac451f97-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.782846 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782805 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmk7d\" (UniqueName: \"kubernetes.io/projected/cf1c862e-1cba-4409-8793-913fac451f97-kube-api-access-lmk7d\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.782846 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.782827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884193 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884150 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf1c862e-1cba-4409-8793-913fac451f97-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884200 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf1c862e-1cba-4409-8793-913fac451f97-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884252 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmk7d\" (UniqueName: \"kubernetes.io/projected/cf1c862e-1cba-4409-8793-913fac451f97-kube-api-access-lmk7d\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884287 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf1c862e-1cba-4409-8793-913fac451f97-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884388 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884369 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884690 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.884961 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.884927 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf1c862e-1cba-4409-8793-913fac451f97-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.887372 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.887349 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf1c862e-1cba-4409-8793-913fac451f97-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.887595 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.887571 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.887674 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.887609 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.891192 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.887843 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf1c862e-1cba-4409-8793-913fac451f97-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.895922 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.895885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf1c862e-1cba-4409-8793-913fac451f97-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:06.896150 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:06.896129 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmk7d\" (UniqueName: \"kubernetes.io/projected/cf1c862e-1cba-4409-8793-913fac451f97-kube-api-access-lmk7d\") pod \"istiod-openshift-gateway-75c67f8887-ckfhp\" (UID: \"cf1c862e-1cba-4409-8793-913fac451f97\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:07.057676 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:07.057577 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:07.233651 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:07.233529 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp"] Jun 11 12:40:07.236077 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:40:07.236042 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1c862e_1cba_4409_8793_913fac451f97.slice/crio-5da14061e0d53c7ea5a7db83ef2e14d787891b0e20e021ab0a5fb5eff207da86 WatchSource:0}: Error finding container 5da14061e0d53c7ea5a7db83ef2e14d787891b0e20e021ab0a5fb5eff207da86: Status 404 returned error can't find the container with id 5da14061e0d53c7ea5a7db83ef2e14d787891b0e20e021ab0a5fb5eff207da86 Jun 11 12:40:07.937531 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:07.937485 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" event={"ID":"cf1c862e-1cba-4409-8793-913fac451f97","Type":"ContainerStarted","Data":"5da14061e0d53c7ea5a7db83ef2e14d787891b0e20e021ab0a5fb5eff207da86"} Jun 11 12:40:13.817796 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:13.817753 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 12:40:13.818090 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:13.817834 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 12:40:13.971166 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:13.971125 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" event={"ID":"cf1c862e-1cba-4409-8793-913fac451f97","Type":"ContainerStarted","Data":"74305c96da1b2f3b633484cab49f6259c6fdef798d9455e40856241bc6acf89c"} Jun 11 12:40:13.971373 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:13.971251 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:13.996093 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:13.996035 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" podStartSLOduration=1.416907767 podStartE2EDuration="7.99601843s" totalImagesPullingTime="6.579110663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:40:13.994228271 +0000 UTC m=+1142.447839406" watchObservedRunningTime="2026-06-11 12:40:13.99601843 +0000 UTC m=+1142.449629528" Jun 11 12:40:14.979720 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:14.979672 2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-ckfhp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 12:40:14.980328 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:14.979746 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" podUID="cf1c862e-1cba-4409-8793-913fac451f97" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:40:17.978453 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:17.978416 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ckfhp" Jun 11 12:40:36.264231 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.264148 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r"] Jun 11 12:40:36.267670 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.267652 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.270647 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.270624 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 12:40:36.270761 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.270627 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 12:40:36.271747 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.271730 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2g7j7\"" Jun 11 12:40:36.276559 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.276523 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r"] Jun 11 12:40:36.345258 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.345220 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8thzl\" (UniqueName: \"kubernetes.io/projected/2a06912a-f63e-4179-880e-33021856d51a-kube-api-access-8thzl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.345437 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.345295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.345437 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.345318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.446561 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.446517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.446737 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.446576 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.446737 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.446614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8thzl\" (UniqueName: \"kubernetes.io/projected/2a06912a-f63e-4179-880e-33021856d51a-kube-api-access-8thzl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.446913 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.446891 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.446953 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.446924 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.456709 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.456678 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8thzl\" (UniqueName: \"kubernetes.io/projected/2a06912a-f63e-4179-880e-33021856d51a-kube-api-access-8thzl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.577803 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.577724 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:36.714364 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.714338 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r"] Jun 11 12:40:36.716052 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:40:36.716020 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a06912a_f63e_4179_880e_33021856d51a.slice/crio-f80da9d204e59a23d9e69c84395aa0688294aac56111b29ff0e4b440a46d6460 WatchSource:0}: Error finding container f80da9d204e59a23d9e69c84395aa0688294aac56111b29ff0e4b440a46d6460: Status 404 returned error can't find the container with id f80da9d204e59a23d9e69c84395aa0688294aac56111b29ff0e4b440a46d6460 Jun 11 12:40:36.863586 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.863532 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f"] Jun 11 12:40:36.866968 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.866950 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:36.875358 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.875324 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f"] Jun 11 12:40:36.951251 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.951218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:36.951428 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.951271 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5jg\" (UniqueName: \"kubernetes.io/projected/9f8eff1d-c3ae-4279-b1a2-5cb328350511-kube-api-access-8r5jg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:36.951428 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:36.951293 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.052519 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.052460 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5jg\" (UniqueName: \"kubernetes.io/projected/9f8eff1d-c3ae-4279-b1a2-5cb328350511-kube-api-access-8r5jg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.052519 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.052524 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.052800 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.052637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.052910 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.052885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.052993 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.052974 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.061051 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.061024 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5jg\" (UniqueName: \"kubernetes.io/projected/9f8eff1d-c3ae-4279-b1a2-5cb328350511-kube-api-access-8r5jg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.081654 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.081578 2569 generic.go:356] "Generic (PLEG): container finished" podID="2a06912a-f63e-4179-880e-33021856d51a" containerID="2f220fbbe0c2ebf1fad0ff8eb0c40d5bb822c44cf5c2f253f4ca7c2242f9e0ca" exitCode=0 Jun 11 12:40:37.081781 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.081661 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" event={"ID":"2a06912a-f63e-4179-880e-33021856d51a","Type":"ContainerDied","Data":"2f220fbbe0c2ebf1fad0ff8eb0c40d5bb822c44cf5c2f253f4ca7c2242f9e0ca"} Jun 11 12:40:37.081781 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.081720 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" event={"ID":"2a06912a-f63e-4179-880e-33021856d51a","Type":"ContainerStarted","Data":"f80da9d204e59a23d9e69c84395aa0688294aac56111b29ff0e4b440a46d6460"} Jun 11 12:40:37.183494 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.183460 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:37.319009 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.318975 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f"] Jun 11 12:40:37.320424 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:40:37.320398 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8eff1d_c3ae_4279_b1a2_5cb328350511.slice/crio-ab7f18a1814a50ebe9c77915baba15f14ab7570bff66a43f74878f96ffec1343 WatchSource:0}: Error finding container ab7f18a1814a50ebe9c77915baba15f14ab7570bff66a43f74878f96ffec1343: Status 404 returned error can't find the container with id ab7f18a1814a50ebe9c77915baba15f14ab7570bff66a43f74878f96ffec1343 Jun 11 12:40:37.462795 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.462763 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg"] Jun 11 12:40:37.466256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.466235 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.475183 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.475160 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg"] Jun 11 12:40:37.557889 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.557856 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrth\" (UniqueName: \"kubernetes.io/projected/08768956-4f70-49d5-b81a-279d3078af32-kube-api-access-wrrth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.558053 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.557894 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.558053 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.557927 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.659233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.659201 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrth\" (UniqueName: \"kubernetes.io/projected/08768956-4f70-49d5-b81a-279d3078af32-kube-api-access-wrrth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.659430 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.659249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.659430 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.659298 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.659721 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.659697 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.659799 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.659715 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.668727 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.668704 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrth\" (UniqueName: \"kubernetes.io/projected/08768956-4f70-49d5-b81a-279d3078af32-kube-api-access-wrrth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.805262 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.805228 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:37.866095 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.866053 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw"] Jun 11 12:40:37.871451 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.871429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:37.878697 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.878667 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw"] Jun 11 12:40:37.957426 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:40:37.957388 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08768956_4f70_49d5_b81a_279d3078af32.slice/crio-59059c1bb2a414546c68f31bbcedbca442e5f0e5ca6247c3b864304283faae1e WatchSource:0}: Error finding container 59059c1bb2a414546c68f31bbcedbca442e5f0e5ca6247c3b864304283faae1e: Status 404 returned error can't find the container with id 59059c1bb2a414546c68f31bbcedbca442e5f0e5ca6247c3b864304283faae1e Jun 11 12:40:37.957426 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.957407 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg"] Jun 11 12:40:37.962360 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.962330 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmbbf\" (UniqueName: \"kubernetes.io/projected/c6a5f759-80a3-4edc-a322-531f5628501b-kube-api-access-pmbbf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:37.962475 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.962454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:37.962531 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:37.962482 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.063784 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.063754 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.063936 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.063862 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.063936 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.063907 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmbbf\" (UniqueName: \"kubernetes.io/projected/c6a5f759-80a3-4edc-a322-531f5628501b-kube-api-access-pmbbf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.064213 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.064190 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.064277 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.064234 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.072036 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.072008 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmbbf\" (UniqueName: \"kubernetes.io/projected/c6a5f759-80a3-4edc-a322-531f5628501b-kube-api-access-pmbbf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.088372 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.088333 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerStarted","Data":"5895c7172e285bc8f889f9e274d8f0223819d9c81ac31d35c5e0f0b4d1cd401d"} Jun 11 12:40:38.088524 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.088394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerStarted","Data":"59059c1bb2a414546c68f31bbcedbca442e5f0e5ca6247c3b864304283faae1e"} Jun 11 12:40:38.090316 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.090290 2569 generic.go:356] "Generic (PLEG): container finished" podID="2a06912a-f63e-4179-880e-33021856d51a" containerID="7e624633eb0612d3344cc6d420874b9ed76b1ae364fd146e613999aab8830587" exitCode=0 Jun 11 12:40:38.090422 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.090357 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" event={"ID":"2a06912a-f63e-4179-880e-33021856d51a","Type":"ContainerDied","Data":"7e624633eb0612d3344cc6d420874b9ed76b1ae364fd146e613999aab8830587"} Jun 11 12:40:38.091948 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.091924 2569 generic.go:356] "Generic (PLEG): container finished" podID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerID="4ffbf5e250be38d4d6c5e713b6b31b008a60ae13f39b527d5952a950fcc971d2" exitCode=0 Jun 11 12:40:38.092052 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.091996 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" event={"ID":"9f8eff1d-c3ae-4279-b1a2-5cb328350511","Type":"ContainerDied","Data":"4ffbf5e250be38d4d6c5e713b6b31b008a60ae13f39b527d5952a950fcc971d2"} Jun 11 12:40:38.092052 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.092033 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" event={"ID":"9f8eff1d-c3ae-4279-b1a2-5cb328350511","Type":"ContainerStarted","Data":"ab7f18a1814a50ebe9c77915baba15f14ab7570bff66a43f74878f96ffec1343"} Jun 11 12:40:38.201873 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.201841 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:38.345658 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:38.345632 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw"] Jun 11 12:40:38.347432 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:40:38.347395 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a5f759_80a3_4edc_a322_531f5628501b.slice/crio-b198abeaec7829bf38430bdd84a56a5ae9df04b053f16c3257420d5bd170222d WatchSource:0}: Error finding container b198abeaec7829bf38430bdd84a56a5ae9df04b053f16c3257420d5bd170222d: Status 404 returned error can't find the container with id b198abeaec7829bf38430bdd84a56a5ae9df04b053f16c3257420d5bd170222d Jun 11 12:40:39.099008 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.098920 2569 generic.go:356] "Generic (PLEG): container finished" podID="08768956-4f70-49d5-b81a-279d3078af32" containerID="5895c7172e285bc8f889f9e274d8f0223819d9c81ac31d35c5e0f0b4d1cd401d" exitCode=0 Jun 11 12:40:39.099145 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.099012 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerDied","Data":"5895c7172e285bc8f889f9e274d8f0223819d9c81ac31d35c5e0f0b4d1cd401d"} Jun 11 12:40:39.101319 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.101292 2569 generic.go:356] "Generic (PLEG): container finished" podID="2a06912a-f63e-4179-880e-33021856d51a" containerID="97017c52e0780ad6245fe57872d8e146a68d2bf34a540bd5dea0ccda9bf21d80" exitCode=0 Jun 11 12:40:39.101458 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.101371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" event={"ID":"2a06912a-f63e-4179-880e-33021856d51a","Type":"ContainerDied","Data":"97017c52e0780ad6245fe57872d8e146a68d2bf34a540bd5dea0ccda9bf21d80"} Jun 11 12:40:39.103459 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.103428 2569 generic.go:356] "Generic (PLEG): container finished" podID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerID="e64b5c2c0dc3d338e69794adbc9f89353c1bb9df68ec8443a29099c9173b269d" exitCode=0 Jun 11 12:40:39.103579 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.103519 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" event={"ID":"9f8eff1d-c3ae-4279-b1a2-5cb328350511","Type":"ContainerDied","Data":"e64b5c2c0dc3d338e69794adbc9f89353c1bb9df68ec8443a29099c9173b269d"} Jun 11 12:40:39.105177 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.105157 2569 generic.go:356] "Generic (PLEG): container finished" podID="c6a5f759-80a3-4edc-a322-531f5628501b" containerID="d3592c9f4b342d60788905f3f58af21c41a4ac9a3d336352d7da14f2cdd9f8ce" exitCode=0 Jun 11 12:40:39.105235 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.105189 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" event={"ID":"c6a5f759-80a3-4edc-a322-531f5628501b","Type":"ContainerDied","Data":"d3592c9f4b342d60788905f3f58af21c41a4ac9a3d336352d7da14f2cdd9f8ce"} Jun 11 12:40:39.105235 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:39.105222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" event={"ID":"c6a5f759-80a3-4edc-a322-531f5628501b","Type":"ContainerStarted","Data":"b198abeaec7829bf38430bdd84a56a5ae9df04b053f16c3257420d5bd170222d"} Jun 11 12:40:40.113324 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.113293 2569 generic.go:356] "Generic (PLEG): container finished" podID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerID="e1afeca245f43cecce3a71e2e4b21a050a83e3718543cf797611e3a4885bbf0f" exitCode=0 Jun 11 12:40:40.113750 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.113381 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" event={"ID":"9f8eff1d-c3ae-4279-b1a2-5cb328350511","Type":"ContainerDied","Data":"e1afeca245f43cecce3a71e2e4b21a050a83e3718543cf797611e3a4885bbf0f"} Jun 11 12:40:40.115723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.115657 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" event={"ID":"c6a5f759-80a3-4edc-a322-531f5628501b","Type":"ContainerStarted","Data":"220b516125882e1270f1d0907329c01050a574277fb4dded574788f310815be1"} Jun 11 12:40:40.117950 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.117913 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerStarted","Data":"9a0af187c5dfa608b7936f2798d92bda8591b1f0d4f383f34b2fe38c2cfadf66"} Jun 11 12:40:40.262526 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.262498 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:40.387318 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.387280 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-bundle\") pod \"2a06912a-f63e-4179-880e-33021856d51a\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " Jun 11 12:40:40.387492 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.387399 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8thzl\" (UniqueName: \"kubernetes.io/projected/2a06912a-f63e-4179-880e-33021856d51a-kube-api-access-8thzl\") pod \"2a06912a-f63e-4179-880e-33021856d51a\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " Jun 11 12:40:40.387492 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.387415 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-util\") pod \"2a06912a-f63e-4179-880e-33021856d51a\" (UID: \"2a06912a-f63e-4179-880e-33021856d51a\") " Jun 11 12:40:40.387934 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.387909 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-bundle" (OuterVolumeSpecName: "bundle") pod "2a06912a-f63e-4179-880e-33021856d51a" (UID: "2a06912a-f63e-4179-880e-33021856d51a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:40.389752 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.389728 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a06912a-f63e-4179-880e-33021856d51a-kube-api-access-8thzl" (OuterVolumeSpecName: "kube-api-access-8thzl") pod "2a06912a-f63e-4179-880e-33021856d51a" (UID: "2a06912a-f63e-4179-880e-33021856d51a"). InnerVolumeSpecName "kube-api-access-8thzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:40:40.392259 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.392233 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-util" (OuterVolumeSpecName: "util") pod "2a06912a-f63e-4179-880e-33021856d51a" (UID: "2a06912a-f63e-4179-880e-33021856d51a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:40.488393 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.488352 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8thzl\" (UniqueName: \"kubernetes.io/projected/2a06912a-f63e-4179-880e-33021856d51a-kube-api-access-8thzl\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:40.488393 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.488386 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:40.488393 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:40.488397 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a06912a-f63e-4179-880e-33021856d51a-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:41.124886 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.124848 2569 generic.go:356] "Generic (PLEG): container finished" podID="08768956-4f70-49d5-b81a-279d3078af32" containerID="9a0af187c5dfa608b7936f2798d92bda8591b1f0d4f383f34b2fe38c2cfadf66" exitCode=0 Jun 11 12:40:41.125339 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.124935 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerDied","Data":"9a0af187c5dfa608b7936f2798d92bda8591b1f0d4f383f34b2fe38c2cfadf66"} Jun 11 12:40:41.127053 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.127031 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" event={"ID":"2a06912a-f63e-4179-880e-33021856d51a","Type":"ContainerDied","Data":"f80da9d204e59a23d9e69c84395aa0688294aac56111b29ff0e4b440a46d6460"} Jun 11 12:40:41.127162 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.127072 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f80da9d204e59a23d9e69c84395aa0688294aac56111b29ff0e4b440a46d6460" Jun 11 12:40:41.127162 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.127040 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r" Jun 11 12:40:41.129048 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.129023 2569 generic.go:356] "Generic (PLEG): container finished" podID="c6a5f759-80a3-4edc-a322-531f5628501b" containerID="220b516125882e1270f1d0907329c01050a574277fb4dded574788f310815be1" exitCode=0 Jun 11 12:40:41.129169 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.129115 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" event={"ID":"c6a5f759-80a3-4edc-a322-531f5628501b","Type":"ContainerDied","Data":"220b516125882e1270f1d0907329c01050a574277fb4dded574788f310815be1"} Jun 11 12:40:41.286413 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.286340 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:41.397157 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.397113 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-bundle\") pod \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " Jun 11 12:40:41.397157 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.397175 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r5jg\" (UniqueName: \"kubernetes.io/projected/9f8eff1d-c3ae-4279-b1a2-5cb328350511-kube-api-access-8r5jg\") pod \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " Jun 11 12:40:41.397449 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.397216 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-util\") pod \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\" (UID: \"9f8eff1d-c3ae-4279-b1a2-5cb328350511\") " Jun 11 12:40:41.397617 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.397582 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-bundle" (OuterVolumeSpecName: "bundle") pod "9f8eff1d-c3ae-4279-b1a2-5cb328350511" (UID: "9f8eff1d-c3ae-4279-b1a2-5cb328350511"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:41.399266 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.399241 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8eff1d-c3ae-4279-b1a2-5cb328350511-kube-api-access-8r5jg" (OuterVolumeSpecName: "kube-api-access-8r5jg") pod "9f8eff1d-c3ae-4279-b1a2-5cb328350511" (UID: "9f8eff1d-c3ae-4279-b1a2-5cb328350511"). InnerVolumeSpecName "kube-api-access-8r5jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:40:41.402725 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.402701 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-util" (OuterVolumeSpecName: "util") pod "9f8eff1d-c3ae-4279-b1a2-5cb328350511" (UID: "9f8eff1d-c3ae-4279-b1a2-5cb328350511"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:41.498350 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.498312 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:41.498350 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.498342 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8eff1d-c3ae-4279-b1a2-5cb328350511-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:41.498350 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:41.498352 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r5jg\" (UniqueName: \"kubernetes.io/projected/9f8eff1d-c3ae-4279-b1a2-5cb328350511-kube-api-access-8r5jg\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:42.136587 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.136532 2569 generic.go:356] "Generic (PLEG): container finished" podID="08768956-4f70-49d5-b81a-279d3078af32" containerID="4ab0fbb073f876c7d24fb3078e42b25709fc5b0efc2e167977c2c68a20df4823" exitCode=0 Jun 11 12:40:42.136587 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.136569 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerDied","Data":"4ab0fbb073f876c7d24fb3078e42b25709fc5b0efc2e167977c2c68a20df4823"} Jun 11 12:40:42.138442 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.138419 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" event={"ID":"9f8eff1d-c3ae-4279-b1a2-5cb328350511","Type":"ContainerDied","Data":"ab7f18a1814a50ebe9c77915baba15f14ab7570bff66a43f74878f96ffec1343"} Jun 11 12:40:42.138442 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.138431 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f" Jun 11 12:40:42.138630 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.138460 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab7f18a1814a50ebe9c77915baba15f14ab7570bff66a43f74878f96ffec1343" Jun 11 12:40:42.140894 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.140866 2569 generic.go:356] "Generic (PLEG): container finished" podID="c6a5f759-80a3-4edc-a322-531f5628501b" containerID="7ed72a6df30de355a3c7ab1da62b20e761bee2876ceaf770ca7ea5e12d8a39b7" exitCode=0 Jun 11 12:40:42.141010 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:42.140906 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" event={"ID":"c6a5f759-80a3-4edc-a322-531f5628501b","Type":"ContainerDied","Data":"7ed72a6df30de355a3c7ab1da62b20e761bee2876ceaf770ca7ea5e12d8a39b7"} Jun 11 12:40:43.304508 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.304473 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:40:43.306642 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.306621 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:43.416859 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.416824 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-util\") pod \"c6a5f759-80a3-4edc-a322-531f5628501b\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " Jun 11 12:40:43.417022 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.416915 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-util\") pod \"08768956-4f70-49d5-b81a-279d3078af32\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " Jun 11 12:40:43.417022 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.416975 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrrth\" (UniqueName: \"kubernetes.io/projected/08768956-4f70-49d5-b81a-279d3078af32-kube-api-access-wrrth\") pod \"08768956-4f70-49d5-b81a-279d3078af32\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " Jun 11 12:40:43.417121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.417027 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-bundle\") pod \"08768956-4f70-49d5-b81a-279d3078af32\" (UID: \"08768956-4f70-49d5-b81a-279d3078af32\") " Jun 11 12:40:43.417121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.417052 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-bundle\") pod \"c6a5f759-80a3-4edc-a322-531f5628501b\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " Jun 11 12:40:43.417121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.417086 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmbbf\" (UniqueName: \"kubernetes.io/projected/c6a5f759-80a3-4edc-a322-531f5628501b-kube-api-access-pmbbf\") pod \"c6a5f759-80a3-4edc-a322-531f5628501b\" (UID: \"c6a5f759-80a3-4edc-a322-531f5628501b\") " Jun 11 12:40:43.418242 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.418133 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-bundle" (OuterVolumeSpecName: "bundle") pod "c6a5f759-80a3-4edc-a322-531f5628501b" (UID: "c6a5f759-80a3-4edc-a322-531f5628501b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:43.418410 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.418248 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-bundle" (OuterVolumeSpecName: "bundle") pod "08768956-4f70-49d5-b81a-279d3078af32" (UID: "08768956-4f70-49d5-b81a-279d3078af32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:43.424687 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.424647 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-util" (OuterVolumeSpecName: "util") pod "c6a5f759-80a3-4edc-a322-531f5628501b" (UID: "c6a5f759-80a3-4edc-a322-531f5628501b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:43.426895 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.426867 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08768956-4f70-49d5-b81a-279d3078af32-kube-api-access-wrrth" (OuterVolumeSpecName: "kube-api-access-wrrth") pod "08768956-4f70-49d5-b81a-279d3078af32" (UID: "08768956-4f70-49d5-b81a-279d3078af32"). InnerVolumeSpecName "kube-api-access-wrrth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:40:43.426895 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.426902 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a5f759-80a3-4edc-a322-531f5628501b-kube-api-access-pmbbf" (OuterVolumeSpecName: "kube-api-access-pmbbf") pod "c6a5f759-80a3-4edc-a322-531f5628501b" (UID: "c6a5f759-80a3-4edc-a322-531f5628501b"). InnerVolumeSpecName "kube-api-access-pmbbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:40:43.457747 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.457700 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-util" (OuterVolumeSpecName: "util") pod "08768956-4f70-49d5-b81a-279d3078af32" (UID: "08768956-4f70-49d5-b81a-279d3078af32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:40:43.518444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.518403 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:43.518444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.518437 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:43.518444 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.518448 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmbbf\" (UniqueName: \"kubernetes.io/projected/c6a5f759-80a3-4edc-a322-531f5628501b-kube-api-access-pmbbf\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:43.518705 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.518459 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a5f759-80a3-4edc-a322-531f5628501b-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:43.518705 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.518467 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08768956-4f70-49d5-b81a-279d3078af32-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:43.518705 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:43.518475 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrrth\" (UniqueName: \"kubernetes.io/projected/08768956-4f70-49d5-b81a-279d3078af32-kube-api-access-wrrth\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:40:44.153956 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:44.153928 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" Jun 11 12:40:44.153956 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:44.153931 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg" event={"ID":"08768956-4f70-49d5-b81a-279d3078af32","Type":"ContainerDied","Data":"59059c1bb2a414546c68f31bbcedbca442e5f0e5ca6247c3b864304283faae1e"} Jun 11 12:40:44.154180 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:44.153990 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59059c1bb2a414546c68f31bbcedbca442e5f0e5ca6247c3b864304283faae1e" Jun 11 12:40:44.155954 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:44.155927 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" event={"ID":"c6a5f759-80a3-4edc-a322-531f5628501b","Type":"ContainerDied","Data":"b198abeaec7829bf38430bdd84a56a5ae9df04b053f16c3257420d5bd170222d"} Jun 11 12:40:44.156099 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:44.155973 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b198abeaec7829bf38430bdd84a56a5ae9df04b053f16c3257420d5bd170222d" Jun 11 12:40:44.156099 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:40:44.156003 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw" Jun 11 12:41:04.776101 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776069 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf"] Jun 11 12:41:04.776480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776433 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="extract" Jun 11 12:41:04.776480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776449 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="extract" Jun 11 12:41:04.776480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776459 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="util" Jun 11 12:41:04.776480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776465 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="util" Jun 11 12:41:04.776480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776475 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="extract" Jun 11 12:41:04.776480 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776480 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776490 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776496 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776502 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776507 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776512 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776517 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776527 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="util" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776533 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="util" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776552 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="util" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776558 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="util" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776564 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776570 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776577 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776582 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776588 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="util" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776592 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="util" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776602 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776607 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="pull" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776662 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="08768956-4f70-49d5-b81a-279d3078af32" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776669 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8eff1d-c3ae-4279-b1a2-5cb328350511" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776675 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a5f759-80a3-4edc-a322-531f5628501b" containerName="extract" Jun 11 12:41:04.776702 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.776683 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a06912a-f63e-4179-880e-33021856d51a" containerName="extract" Jun 11 12:41:04.783683 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.783663 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:04.787710 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.787678 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 12:41:04.787710 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.787701 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4kfxn\"" Jun 11 12:41:04.788250 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.788235 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 12:41:04.793877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.793855 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf"] Jun 11 12:41:04.896289 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.896249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:04.896468 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.896293 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmfx6\" (UniqueName: \"kubernetes.io/projected/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-kube-api-access-lmfx6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:04.997297 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.997258 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:04.997297 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.997305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmfx6\" (UniqueName: \"kubernetes.io/projected/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-kube-api-access-lmfx6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:04.997693 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:04.997671 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:05.007621 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:05.007592 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmfx6\" (UniqueName: \"kubernetes.io/projected/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-kube-api-access-lmfx6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:05.095657 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:05.095569 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:05.244452 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:05.244425 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf"] Jun 11 12:41:05.246607 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:41:05.246578 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fd8b3a_9bc7_45a2_836d_c48cebf2e85e.slice/crio-85d17e1e8b663e8d4a892c83c8d0d8e6f8c4ed661508761f8b7dcb27b56f5770 WatchSource:0}: Error finding container 85d17e1e8b663e8d4a892c83c8d0d8e6f8c4ed661508761f8b7dcb27b56f5770: Status 404 returned error can't find the container with id 85d17e1e8b663e8d4a892c83c8d0d8e6f8c4ed661508761f8b7dcb27b56f5770 Jun 11 12:41:05.273314 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:05.273280 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" event={"ID":"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e","Type":"ContainerStarted","Data":"85d17e1e8b663e8d4a892c83c8d0d8e6f8c4ed661508761f8b7dcb27b56f5770"} Jun 11 12:41:12.148644 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.148610 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:41:12.149649 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.149630 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:41:12.156607 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.156585 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:41:12.157826 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.157809 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:41:12.321940 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.321903 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" event={"ID":"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e","Type":"ContainerStarted","Data":"65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41"} Jun 11 12:41:12.322120 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.322036 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:12.352512 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:12.352456 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" podStartSLOduration=1.417252609 podStartE2EDuration="8.352439757s" totalImagesPullingTime="6.935187148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:12.34932311 +0000 UTC m=+1200.802934206" watchObservedRunningTime="2026-06-11 12:41:12.352439757 +0000 UTC m=+1200.806050854" Jun 11 12:41:23.330191 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:23.330157 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.009189 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.009152 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf"] Jun 11 12:41:25.009620 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.009330 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" containerName="manager" containerID="cri-o://65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41" gracePeriod=2 Jun 11 12:41:25.019397 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.019368 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf"] Jun 11 12:41:25.072865 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.072831 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl"] Jun 11 12:41:25.073239 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.073222 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" containerName="manager" Jun 11 12:41:25.073325 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.073241 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" containerName="manager" Jun 11 12:41:25.073402 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.073346 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" containerName="manager" Jun 11 12:41:25.076689 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.076666 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.117959 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.117929 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d"] Jun 11 12:41:25.121514 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.121489 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:25.126657 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.126630 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xbgtm\"" Jun 11 12:41:25.135817 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.135791 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl"] Jun 11 12:41:25.160827 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.160759 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d"] Jun 11 12:41:25.173621 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:25.173574 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" is forbidden: User \"system:node:ip-10-0-132-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-239.ec2.internal' and this object" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.174880 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.174853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvcnk\" (UniqueName: \"kubernetes.io/projected/f11ff74e-8a6c-4c8e-a658-475b585e61d9-kube-api-access-dvcnk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ft6sl\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.174984 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.174889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f11ff74e-8a6c-4c8e-a658-475b585e61d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ft6sl\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.176494 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:25.176461 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" is forbidden: User \"system:node:ip-10-0-132-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-239.ec2.internal' and this object" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.271158 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.271097 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.274144 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:25.274116 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" is forbidden: User \"system:node:ip-10-0-132-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-239.ec2.internal' and this object" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.275397 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.275372 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4fsw\" (UniqueName: \"kubernetes.io/projected/92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63-kube-api-access-r4fsw\") pod \"limitador-operator-controller-manager-859d7b78bd-9888d\" (UID: \"92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:25.275525 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.275417 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvcnk\" (UniqueName: \"kubernetes.io/projected/f11ff74e-8a6c-4c8e-a658-475b585e61d9-kube-api-access-dvcnk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ft6sl\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.275525 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.275443 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f11ff74e-8a6c-4c8e-a658-475b585e61d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ft6sl\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.275752 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.275735 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f11ff74e-8a6c-4c8e-a658-475b585e61d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ft6sl\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.289936 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.289906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvcnk\" (UniqueName: \"kubernetes.io/projected/f11ff74e-8a6c-4c8e-a658-475b585e61d9-kube-api-access-dvcnk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ft6sl\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.376401 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.376373 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmfx6\" (UniqueName: \"kubernetes.io/projected/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-kube-api-access-lmfx6\") pod \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " Jun 11 12:41:25.376613 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.376425 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-extensions-socket-volume\") pod \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\" (UID: \"42fd8b3a-9bc7-45a2-836d-c48cebf2e85e\") " Jun 11 12:41:25.376613 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.376509 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4fsw\" (UniqueName: \"kubernetes.io/projected/92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63-kube-api-access-r4fsw\") pod \"limitador-operator-controller-manager-859d7b78bd-9888d\" (UID: \"92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:25.377003 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.376976 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" (UID: "42fd8b3a-9bc7-45a2-836d-c48cebf2e85e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:41:25.378487 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.378460 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-kube-api-access-lmfx6" (OuterVolumeSpecName: "kube-api-access-lmfx6") pod "42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" (UID: "42fd8b3a-9bc7-45a2-836d-c48cebf2e85e"). InnerVolumeSpecName "kube-api-access-lmfx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:41:25.386748 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.386721 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4fsw\" (UniqueName: \"kubernetes.io/projected/92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63-kube-api-access-r4fsw\") pod \"limitador-operator-controller-manager-859d7b78bd-9888d\" (UID: \"92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:25.397760 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.397733 2569 generic.go:356] "Generic (PLEG): container finished" podID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" containerID="65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41" exitCode=0 Jun 11 12:41:25.397871 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.397779 2569 scope.go:117] "RemoveContainer" containerID="65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41" Jun 11 12:41:25.397871 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.397784 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.398775 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.398678 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:25.400437 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:25.400406 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" is forbidden: User \"system:node:ip-10-0-132-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-239.ec2.internal' and this object" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.409202 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:25.409061 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wp8xf\" is forbidden: User \"system:node:ip-10-0-132-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-239.ec2.internal' and this object" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wp8xf" Jun 11 12:41:25.409273 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.409211 2569 scope.go:117] "RemoveContainer" containerID="65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41" Jun 11 12:41:25.409475 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:25.409451 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41\": container with ID starting with 65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41 not found: ID does not exist" containerID="65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41" Jun 11 12:41:25.409588 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.409480 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41"} err="failed to get container status \"65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41\": rpc error: code = NotFound desc = could not find container \"65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41\": container with ID starting with 65df4bc2e398ce9a145003f8357488ff58ae6c4ebfdea8ac33a3f738533cbd41 not found: ID does not exist" Jun 11 12:41:25.434841 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.434801 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:25.477496 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.477456 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-extensions-socket-volume\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:41:25.477496 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.477495 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmfx6\" (UniqueName: \"kubernetes.io/projected/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e-kube-api-access-lmfx6\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:41:25.552879 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.552852 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl"] Jun 11 12:41:25.554716 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:41:25.554678 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11ff74e_8a6c_4c8e_a658_475b585e61d9.slice/crio-354443114bb35b3cec1ffdf8e5e5832077bcdaa30b8b7ca200595a7e57efd511 WatchSource:0}: Error finding container 354443114bb35b3cec1ffdf8e5e5832077bcdaa30b8b7ca200595a7e57efd511: Status 404 returned error can't find the container with id 354443114bb35b3cec1ffdf8e5e5832077bcdaa30b8b7ca200595a7e57efd511 Jun 11 12:41:25.590946 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.590919 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d"] Jun 11 12:41:25.593716 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:41:25.593676 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e9c0ae_ba69_4a90_b3cf_e6ac7fd43a63.slice/crio-588d59b8afaf8a0aa9b4c802fbf0a824695fa5e5625ac0d9f13fc0117cd3b00e WatchSource:0}: Error finding container 588d59b8afaf8a0aa9b4c802fbf0a824695fa5e5625ac0d9f13fc0117cd3b00e: Status 404 returned error can't find the container with id 588d59b8afaf8a0aa9b4c802fbf0a824695fa5e5625ac0d9f13fc0117cd3b00e Jun 11 12:41:25.958499 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:25.958465 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42fd8b3a-9bc7-45a2-836d-c48cebf2e85e" path="/var/lib/kubelet/pods/42fd8b3a-9bc7-45a2-836d-c48cebf2e85e/volumes" Jun 11 12:41:26.406201 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:26.406159 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" event={"ID":"f11ff74e-8a6c-4c8e-a658-475b585e61d9","Type":"ContainerStarted","Data":"0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83"} Jun 11 12:41:26.406700 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:26.406214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" event={"ID":"f11ff74e-8a6c-4c8e-a658-475b585e61d9","Type":"ContainerStarted","Data":"354443114bb35b3cec1ffdf8e5e5832077bcdaa30b8b7ca200595a7e57efd511"} Jun 11 12:41:26.406700 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:26.406326 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:26.407486 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:26.407460 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" event={"ID":"92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63","Type":"ContainerStarted","Data":"588d59b8afaf8a0aa9b4c802fbf0a824695fa5e5625ac0d9f13fc0117cd3b00e"} Jun 11 12:41:26.431801 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:26.431748 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" podStartSLOduration=1.431733145 podStartE2EDuration="1.431733145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:26.430398315 +0000 UTC m=+1214.884009415" watchObservedRunningTime="2026-06-11 12:41:26.431733145 +0000 UTC m=+1214.885344242" Jun 11 12:41:27.414372 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:27.414339 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" event={"ID":"92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63","Type":"ContainerStarted","Data":"0aff29a63053283c5f374a3bbe62bbe1c096738cbd11a1883c646362257e1f47"} Jun 11 12:41:27.414828 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:27.414722 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:27.441640 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:27.441586 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" podStartSLOduration=0.981400509 podStartE2EDuration="2.441569361s" totalImagesPullingTime="1.460168852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:27.438168379 +0000 UTC m=+1215.891779477" watchObservedRunningTime="2026-06-11 12:41:27.441569361 +0000 UTC m=+1215.895180458" Jun 11 12:41:37.416930 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:37.416898 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:39.427986 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:39.427956 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9888d" Jun 11 12:41:54.135027 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.134991 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl"] Jun 11 12:41:54.135472 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.135205 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" podUID="f11ff74e-8a6c-4c8e-a658-475b585e61d9" containerName="manager" containerID="cri-o://0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83" gracePeriod=10 Jun 11 12:41:54.348984 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.348954 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x"] Jun 11 12:41:54.351997 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.351979 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.369501 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.369474 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x"] Jun 11 12:41:54.388877 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.388821 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:54.411944 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.411902 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24kzr\" (UniqueName: \"kubernetes.io/projected/1cdce10c-65cf-465e-bc25-ea0bea5005a0-kube-api-access-24kzr\") pod \"kuadrant-operator-controller-manager-86878c769f-5j56x\" (UID: \"1cdce10c-65cf-465e-bc25-ea0bea5005a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.412100 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.411978 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdce10c-65cf-465e-bc25-ea0bea5005a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5j56x\" (UID: \"1cdce10c-65cf-465e-bc25-ea0bea5005a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.512399 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.512368 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f11ff74e-8a6c-4c8e-a658-475b585e61d9-extensions-socket-volume\") pod \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " Jun 11 12:41:54.512600 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.512420 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvcnk\" (UniqueName: \"kubernetes.io/projected/f11ff74e-8a6c-4c8e-a658-475b585e61d9-kube-api-access-dvcnk\") pod \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\" (UID: \"f11ff74e-8a6c-4c8e-a658-475b585e61d9\") " Jun 11 12:41:54.512679 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.512612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24kzr\" (UniqueName: \"kubernetes.io/projected/1cdce10c-65cf-465e-bc25-ea0bea5005a0-kube-api-access-24kzr\") pod \"kuadrant-operator-controller-manager-86878c769f-5j56x\" (UID: \"1cdce10c-65cf-465e-bc25-ea0bea5005a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.512743 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.512681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdce10c-65cf-465e-bc25-ea0bea5005a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5j56x\" (UID: \"1cdce10c-65cf-465e-bc25-ea0bea5005a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.512829 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.512796 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11ff74e-8a6c-4c8e-a658-475b585e61d9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f11ff74e-8a6c-4c8e-a658-475b585e61d9" (UID: "f11ff74e-8a6c-4c8e-a658-475b585e61d9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:41:54.513090 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.513067 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdce10c-65cf-465e-bc25-ea0bea5005a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5j56x\" (UID: \"1cdce10c-65cf-465e-bc25-ea0bea5005a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.514439 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.514416 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11ff74e-8a6c-4c8e-a658-475b585e61d9-kube-api-access-dvcnk" (OuterVolumeSpecName: "kube-api-access-dvcnk") pod "f11ff74e-8a6c-4c8e-a658-475b585e61d9" (UID: "f11ff74e-8a6c-4c8e-a658-475b585e61d9"). InnerVolumeSpecName "kube-api-access-dvcnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:41:54.524723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.524700 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24kzr\" (UniqueName: \"kubernetes.io/projected/1cdce10c-65cf-465e-bc25-ea0bea5005a0-kube-api-access-24kzr\") pod \"kuadrant-operator-controller-manager-86878c769f-5j56x\" (UID: \"1cdce10c-65cf-465e-bc25-ea0bea5005a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.559698 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.559668 2569 generic.go:356] "Generic (PLEG): container finished" podID="f11ff74e-8a6c-4c8e-a658-475b585e61d9" containerID="0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83" exitCode=0 Jun 11 12:41:54.559845 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.559712 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" Jun 11 12:41:54.559845 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.559766 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" event={"ID":"f11ff74e-8a6c-4c8e-a658-475b585e61d9","Type":"ContainerDied","Data":"0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83"} Jun 11 12:41:54.559845 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.559829 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl" event={"ID":"f11ff74e-8a6c-4c8e-a658-475b585e61d9","Type":"ContainerDied","Data":"354443114bb35b3cec1ffdf8e5e5832077bcdaa30b8b7ca200595a7e57efd511"} Jun 11 12:41:54.560009 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.559864 2569 scope.go:117] "RemoveContainer" containerID="0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83" Jun 11 12:41:54.571527 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.571508 2569 scope.go:117] "RemoveContainer" containerID="0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83" Jun 11 12:41:54.571826 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:41:54.571805 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83\": container with ID starting with 0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83 not found: ID does not exist" containerID="0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83" Jun 11 12:41:54.571906 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.571833 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83"} err="failed to get container status \"0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83\": rpc error: code = NotFound desc = could not find container \"0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83\": container with ID starting with 0c5b031d44f6a7ab95c2324ef239739af27cc5061be8899fd195802b6b935f83 not found: ID does not exist" Jun 11 12:41:54.594963 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.594935 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl"] Jun 11 12:41:54.597123 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.597105 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ft6sl"] Jun 11 12:41:54.613425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.613391 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f11ff74e-8a6c-4c8e-a658-475b585e61d9-extensions-socket-volume\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:41:54.613425 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.613427 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvcnk\" (UniqueName: \"kubernetes.io/projected/f11ff74e-8a6c-4c8e-a658-475b585e61d9-kube-api-access-dvcnk\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:41:54.662229 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.662199 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:54.799202 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:54.799176 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x"] Jun 11 12:41:54.801086 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:41:54.801060 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdce10c_65cf_465e_bc25_ea0bea5005a0.slice/crio-d1edf145689ed259882652d30ee6e3e2c02c984f07704f9bb4a6c070afcb952d WatchSource:0}: Error finding container d1edf145689ed259882652d30ee6e3e2c02c984f07704f9bb4a6c070afcb952d: Status 404 returned error can't find the container with id d1edf145689ed259882652d30ee6e3e2c02c984f07704f9bb4a6c070afcb952d Jun 11 12:41:55.567182 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:55.567140 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" event={"ID":"1cdce10c-65cf-465e-bc25-ea0bea5005a0","Type":"ContainerStarted","Data":"de64093e731a001956b008192514d8b935388fff7c62d81e5a289cda386566ce"} Jun 11 12:41:55.567568 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:55.567206 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" event={"ID":"1cdce10c-65cf-465e-bc25-ea0bea5005a0","Type":"ContainerStarted","Data":"d1edf145689ed259882652d30ee6e3e2c02c984f07704f9bb4a6c070afcb952d"} Jun 11 12:41:55.567568 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:55.567250 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:41:55.596602 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:55.596519 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" podStartSLOduration=1.596502635 podStartE2EDuration="1.596502635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:55.594107844 +0000 UTC m=+1244.047718923" watchObservedRunningTime="2026-06-11 12:41:55.596502635 +0000 UTC m=+1244.050113731" Jun 11 12:41:55.952764 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:41:55.952729 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f11ff74e-8a6c-4c8e-a658-475b585e61d9" path="/var/lib/kubelet/pods/f11ff74e-8a6c-4c8e-a658-475b585e61d9/volumes" Jun 11 12:42:06.575902 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:06.575823 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5j56x" Jun 11 12:42:47.136280 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.136246 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5"] Jun 11 12:42:47.136787 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.136619 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11ff74e-8a6c-4c8e-a658-475b585e61d9" containerName="manager" Jun 11 12:42:47.136787 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.136630 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11ff74e-8a6c-4c8e-a658-475b585e61d9" containerName="manager" Jun 11 12:42:47.136787 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.136699 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11ff74e-8a6c-4c8e-a658-475b585e61d9" containerName="manager" Jun 11 12:42:47.139938 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.139920 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.143074 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.143054 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 12:42:47.144209 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.144192 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6d8vq\"" Jun 11 12:42:47.144287 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.144213 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 12:42:47.151851 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.151827 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5"] Jun 11 12:42:47.257667 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.257634 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.257841 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.257710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.257841 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.257752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jk8\" (UniqueName: \"kubernetes.io/projected/3cec35bc-15b3-494e-bd5f-410c898c663e-kube-api-access-z7jk8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.358161 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.358128 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.358322 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.358170 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jk8\" (UniqueName: \"kubernetes.io/projected/3cec35bc-15b3-494e-bd5f-410c898c663e-kube-api-access-z7jk8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.358322 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.358201 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.358723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.358590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.358723 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.358590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.369490 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.369466 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jk8\" (UniqueName: \"kubernetes.io/projected/3cec35bc-15b3-494e-bd5f-410c898c663e-kube-api-access-z7jk8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.449503 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.449483 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:47.597533 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.595425 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5"] Jun 11 12:42:47.601430 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:42:47.601400 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cec35bc_15b3_494e_bd5f_410c898c663e.slice/crio-1dce0de5f907326f90f336d30d95fec50e8bd13c5acece91a99235f611f54a75 WatchSource:0}: Error finding container 1dce0de5f907326f90f336d30d95fec50e8bd13c5acece91a99235f611f54a75: Status 404 returned error can't find the container with id 1dce0de5f907326f90f336d30d95fec50e8bd13c5acece91a99235f611f54a75 Jun 11 12:42:47.853117 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.853076 2569 generic.go:356] "Generic (PLEG): container finished" podID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerID="74d7380e98c44d3c7d3742eed6bd78c8d270e03ed666e9cfbae4c713b2a1d373" exitCode=0 Jun 11 12:42:47.853117 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.853119 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" event={"ID":"3cec35bc-15b3-494e-bd5f-410c898c663e","Type":"ContainerDied","Data":"74d7380e98c44d3c7d3742eed6bd78c8d270e03ed666e9cfbae4c713b2a1d373"} Jun 11 12:42:47.853312 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.853162 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" event={"ID":"3cec35bc-15b3-494e-bd5f-410c898c663e","Type":"ContainerStarted","Data":"1dce0de5f907326f90f336d30d95fec50e8bd13c5acece91a99235f611f54a75"} Jun 11 12:42:47.854157 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:47.854137 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:42:48.860260 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:48.860226 2569 generic.go:356] "Generic (PLEG): container finished" podID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerID="ccbb8a699f449966dd3e251504df420b8738c14f9d4ee8353c6b356f990f7cd7" exitCode=0 Jun 11 12:42:48.860654 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:48.860310 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" event={"ID":"3cec35bc-15b3-494e-bd5f-410c898c663e","Type":"ContainerDied","Data":"ccbb8a699f449966dd3e251504df420b8738c14f9d4ee8353c6b356f990f7cd7"} Jun 11 12:42:49.868819 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:49.868778 2569 generic.go:356] "Generic (PLEG): container finished" podID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerID="8aee102d3eaae5a3e9eea9d293a6fcf17ba2e6b5b0d15dd0c2cad0654ae47282" exitCode=0 Jun 11 12:42:49.869229 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:49.868865 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" event={"ID":"3cec35bc-15b3-494e-bd5f-410c898c663e","Type":"ContainerDied","Data":"8aee102d3eaae5a3e9eea9d293a6fcf17ba2e6b5b0d15dd0c2cad0654ae47282"} Jun 11 12:42:51.003202 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.003177 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:51.192312 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.192278 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-bundle\") pod \"3cec35bc-15b3-494e-bd5f-410c898c663e\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " Jun 11 12:42:51.192467 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.192347 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-util\") pod \"3cec35bc-15b3-494e-bd5f-410c898c663e\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " Jun 11 12:42:51.192467 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.192440 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7jk8\" (UniqueName: \"kubernetes.io/projected/3cec35bc-15b3-494e-bd5f-410c898c663e-kube-api-access-z7jk8\") pod \"3cec35bc-15b3-494e-bd5f-410c898c663e\" (UID: \"3cec35bc-15b3-494e-bd5f-410c898c663e\") " Jun 11 12:42:51.192756 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.192735 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-bundle" (OuterVolumeSpecName: "bundle") pod "3cec35bc-15b3-494e-bd5f-410c898c663e" (UID: "3cec35bc-15b3-494e-bd5f-410c898c663e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:42:51.194515 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.194487 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cec35bc-15b3-494e-bd5f-410c898c663e-kube-api-access-z7jk8" (OuterVolumeSpecName: "kube-api-access-z7jk8") pod "3cec35bc-15b3-494e-bd5f-410c898c663e" (UID: "3cec35bc-15b3-494e-bd5f-410c898c663e"). InnerVolumeSpecName "kube-api-access-z7jk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:42:51.198038 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.198004 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-util" (OuterVolumeSpecName: "util") pod "3cec35bc-15b3-494e-bd5f-410c898c663e" (UID: "3cec35bc-15b3-494e-bd5f-410c898c663e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:42:51.293367 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.293310 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7jk8\" (UniqueName: \"kubernetes.io/projected/3cec35bc-15b3-494e-bd5f-410c898c663e-kube-api-access-z7jk8\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:42:51.293367 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.293360 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-bundle\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:42:51.293367 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.293371 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cec35bc-15b3-494e-bd5f-410c898c663e-util\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:42:51.881763 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.881732 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" event={"ID":"3cec35bc-15b3-494e-bd5f-410c898c663e","Type":"ContainerDied","Data":"1dce0de5f907326f90f336d30d95fec50e8bd13c5acece91a99235f611f54a75"} Jun 11 12:42:51.881763 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.881751 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z5hp5" Jun 11 12:42:51.881960 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:42:51.881779 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dce0de5f907326f90f336d30d95fec50e8bd13c5acece91a99235f611f54a75" Jun 11 12:43:46.824039 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.823965 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774f4f7676-9vd82"] Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824325 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="extract" Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824336 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="extract" Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824345 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="pull" Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824350 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="pull" Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824365 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="util" Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824371 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="util" Jun 11 12:43:46.824469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.824424 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cec35bc-15b3-494e-bd5f-410c898c663e" containerName="extract" Jun 11 12:43:46.827295 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.827278 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:46.830361 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.830339 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 12:43:46.830535 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.830420 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 12:43:46.830535 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.830431 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fx6nh\"" Jun 11 12:43:46.838920 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.838890 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774f4f7676-9vd82"] Jun 11 12:43:46.961792 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.961741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5k5\" (UniqueName: \"kubernetes.io/projected/d51fb192-58e3-4998-aae7-94befa6c1bd1-kube-api-access-sh5k5\") pod \"maas-controller-774f4f7676-9vd82\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:46.961990 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.961853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51fb192-58e3-4998-aae7-94befa6c1bd1-webhook-cert\") pod \"maas-controller-774f4f7676-9vd82\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:46.981650 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.981613 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5db5788859-lm9fc"] Jun 11 12:43:46.985382 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.985362 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:46.997469 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:46.997442 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5db5788859-lm9fc"] Jun 11 12:43:47.062454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.062418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51fb192-58e3-4998-aae7-94befa6c1bd1-webhook-cert\") pod \"maas-controller-774f4f7676-9vd82\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:47.062645 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.062498 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5k5\" (UniqueName: \"kubernetes.io/projected/d51fb192-58e3-4998-aae7-94befa6c1bd1-kube-api-access-sh5k5\") pod \"maas-controller-774f4f7676-9vd82\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:47.064850 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.064830 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51fb192-58e3-4998-aae7-94befa6c1bd1-webhook-cert\") pod \"maas-controller-774f4f7676-9vd82\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:47.070997 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.070964 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5k5\" (UniqueName: \"kubernetes.io/projected/d51fb192-58e3-4998-aae7-94befa6c1bd1-kube-api-access-sh5k5\") pod \"maas-controller-774f4f7676-9vd82\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:47.145413 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.145328 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:47.163680 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.163637 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ceb292e-ca8c-47cb-b5f1-97406454e726-webhook-cert\") pod \"maas-controller-5db5788859-lm9fc\" (UID: \"2ceb292e-ca8c-47cb-b5f1-97406454e726\") " pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.163824 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.163748 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt75g\" (UniqueName: \"kubernetes.io/projected/2ceb292e-ca8c-47cb-b5f1-97406454e726-kube-api-access-xt75g\") pod \"maas-controller-5db5788859-lm9fc\" (UID: \"2ceb292e-ca8c-47cb-b5f1-97406454e726\") " pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.265119 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.265080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ceb292e-ca8c-47cb-b5f1-97406454e726-webhook-cert\") pod \"maas-controller-5db5788859-lm9fc\" (UID: \"2ceb292e-ca8c-47cb-b5f1-97406454e726\") " pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.265306 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.265145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt75g\" (UniqueName: \"kubernetes.io/projected/2ceb292e-ca8c-47cb-b5f1-97406454e726-kube-api-access-xt75g\") pod \"maas-controller-5db5788859-lm9fc\" (UID: \"2ceb292e-ca8c-47cb-b5f1-97406454e726\") " pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.267514 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.267487 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ceb292e-ca8c-47cb-b5f1-97406454e726-webhook-cert\") pod \"maas-controller-5db5788859-lm9fc\" (UID: \"2ceb292e-ca8c-47cb-b5f1-97406454e726\") " pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.279446 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.279421 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt75g\" (UniqueName: \"kubernetes.io/projected/2ceb292e-ca8c-47cb-b5f1-97406454e726-kube-api-access-xt75g\") pod \"maas-controller-5db5788859-lm9fc\" (UID: \"2ceb292e-ca8c-47cb-b5f1-97406454e726\") " pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.283753 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.283727 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774f4f7676-9vd82"] Jun 11 12:43:47.284641 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:43:47.284612 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51fb192_58e3_4998_aae7_94befa6c1bd1.slice/crio-db78bb42773114fc2d3937f2152bb6e8612c1849e3c6f1f50a60d063b1fdaf5a WatchSource:0}: Error finding container db78bb42773114fc2d3937f2152bb6e8612c1849e3c6f1f50a60d063b1fdaf5a: Status 404 returned error can't find the container with id db78bb42773114fc2d3937f2152bb6e8612c1849e3c6f1f50a60d063b1fdaf5a Jun 11 12:43:47.295163 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.295142 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:47.428210 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:47.428181 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5db5788859-lm9fc"] Jun 11 12:43:47.429508 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:43:47.429485 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ceb292e_ca8c_47cb_b5f1_97406454e726.slice/crio-870055abbe5bace46e02637a2c9ce966f68df9e19ac9ba7ba68f54e1f907b118 WatchSource:0}: Error finding container 870055abbe5bace46e02637a2c9ce966f68df9e19ac9ba7ba68f54e1f907b118: Status 404 returned error can't find the container with id 870055abbe5bace46e02637a2c9ce966f68df9e19ac9ba7ba68f54e1f907b118 Jun 11 12:43:48.184652 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:48.184611 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-9vd82" event={"ID":"d51fb192-58e3-4998-aae7-94befa6c1bd1","Type":"ContainerStarted","Data":"db78bb42773114fc2d3937f2152bb6e8612c1849e3c6f1f50a60d063b1fdaf5a"} Jun 11 12:43:48.186884 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:48.186851 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5db5788859-lm9fc" event={"ID":"2ceb292e-ca8c-47cb-b5f1-97406454e726","Type":"ContainerStarted","Data":"870055abbe5bace46e02637a2c9ce966f68df9e19ac9ba7ba68f54e1f907b118"} Jun 11 12:43:50.201447 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:50.201401 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-9vd82" event={"ID":"d51fb192-58e3-4998-aae7-94befa6c1bd1","Type":"ContainerStarted","Data":"31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c"} Jun 11 12:43:50.201896 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:50.201480 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:43:50.203149 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:50.203124 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5db5788859-lm9fc" event={"ID":"2ceb292e-ca8c-47cb-b5f1-97406454e726","Type":"ContainerStarted","Data":"8f0548c7aa10ce93a001302bfe144046c6338a9a0db5c654bf2ff41efc1c982b"} Jun 11 12:43:50.203268 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:50.203180 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:43:50.224143 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:50.224083 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-774f4f7676-9vd82" podStartSLOduration=1.64495242 podStartE2EDuration="4.224066283s" totalImagesPullingTime="2.579113863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:43:50.221467423 +0000 UTC m=+1358.675078520" watchObservedRunningTime="2026-06-11 12:43:50.224066283 +0000 UTC m=+1358.677677432" Jun 11 12:43:50.241013 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:43:50.240962 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5db5788859-lm9fc" podStartSLOduration=1.798927707 podStartE2EDuration="4.240944787s" totalImagesPullingTime="2.44201708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:43:50.238881783 +0000 UTC m=+1358.692492881" watchObservedRunningTime="2026-06-11 12:43:50.240944787 +0000 UTC m=+1358.694555912" Jun 11 12:44:01.213875 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.213843 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5db5788859-lm9fc" Jun 11 12:44:01.214393 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.214081 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:44:01.279619 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.279590 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774f4f7676-9vd82"] Jun 11 12:44:01.279788 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.279768 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-774f4f7676-9vd82" podUID="d51fb192-58e3-4998-aae7-94befa6c1bd1" containerName="manager" containerID="cri-o://31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c" gracePeriod=30 Jun 11 12:44:01.511622 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.511595 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:44:01.589006 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.588976 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh5k5\" (UniqueName: \"kubernetes.io/projected/d51fb192-58e3-4998-aae7-94befa6c1bd1-kube-api-access-sh5k5\") pod \"d51fb192-58e3-4998-aae7-94befa6c1bd1\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " Jun 11 12:44:01.589178 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.589015 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51fb192-58e3-4998-aae7-94befa6c1bd1-webhook-cert\") pod \"d51fb192-58e3-4998-aae7-94befa6c1bd1\" (UID: \"d51fb192-58e3-4998-aae7-94befa6c1bd1\") " Jun 11 12:44:01.591117 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.591090 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51fb192-58e3-4998-aae7-94befa6c1bd1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d51fb192-58e3-4998-aae7-94befa6c1bd1" (UID: "d51fb192-58e3-4998-aae7-94befa6c1bd1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:44:01.591216 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.591154 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51fb192-58e3-4998-aae7-94befa6c1bd1-kube-api-access-sh5k5" (OuterVolumeSpecName: "kube-api-access-sh5k5") pod "d51fb192-58e3-4998-aae7-94befa6c1bd1" (UID: "d51fb192-58e3-4998-aae7-94befa6c1bd1"). InnerVolumeSpecName "kube-api-access-sh5k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:44:01.690233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.690209 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh5k5\" (UniqueName: \"kubernetes.io/projected/d51fb192-58e3-4998-aae7-94befa6c1bd1-kube-api-access-sh5k5\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:44:01.690233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:01.690231 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51fb192-58e3-4998-aae7-94befa6c1bd1-webhook-cert\") on node \"ip-10-0-132-239.ec2.internal\" DevicePath \"\"" Jun 11 12:44:02.267827 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.267734 2569 generic.go:356] "Generic (PLEG): container finished" podID="d51fb192-58e3-4998-aae7-94befa6c1bd1" containerID="31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c" exitCode=0 Jun 11 12:44:02.267827 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.267790 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-9vd82" Jun 11 12:44:02.267827 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.267817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-9vd82" event={"ID":"d51fb192-58e3-4998-aae7-94befa6c1bd1","Type":"ContainerDied","Data":"31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c"} Jun 11 12:44:02.268357 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.267872 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-9vd82" event={"ID":"d51fb192-58e3-4998-aae7-94befa6c1bd1","Type":"ContainerDied","Data":"db78bb42773114fc2d3937f2152bb6e8612c1849e3c6f1f50a60d063b1fdaf5a"} Jun 11 12:44:02.268357 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.267894 2569 scope.go:117] "RemoveContainer" containerID="31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c" Jun 11 12:44:02.276814 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.276796 2569 scope.go:117] "RemoveContainer" containerID="31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c" Jun 11 12:44:02.277051 ip-10-0-132-239 kubenswrapper[2569]: E0611 12:44:02.277029 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c\": container with ID starting with 31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c not found: ID does not exist" containerID="31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c" Jun 11 12:44:02.277104 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.277061 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c"} err="failed to get container status \"31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c\": rpc error: code = NotFound desc = could not find container \"31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c\": container with ID starting with 31c36a497fbfdb278534e9fdd9647033d6882d62cddb16171168eb4d1376c75c not found: ID does not exist" Jun 11 12:44:02.286134 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.286103 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774f4f7676-9vd82"] Jun 11 12:44:02.290516 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:02.290494 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-774f4f7676-9vd82"] Jun 11 12:44:03.951722 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:03.951691 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51fb192-58e3-4998-aae7-94befa6c1bd1" path="/var/lib/kubelet/pods/d51fb192-58e3-4998-aae7-94befa6c1bd1/volumes" Jun 11 12:44:19.314379 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.314340 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-845d5d9dc5-8s4wm"] Jun 11 12:44:19.314813 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.314735 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51fb192-58e3-4998-aae7-94befa6c1bd1" containerName="manager" Jun 11 12:44:19.314813 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.314750 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51fb192-58e3-4998-aae7-94befa6c1bd1" containerName="manager" Jun 11 12:44:19.314813 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.314808 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51fb192-58e3-4998-aae7-94befa6c1bd1" containerName="manager" Jun 11 12:44:19.319051 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.319031 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.321934 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.321914 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 12:44:19.323206 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.323186 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rdl8z\"" Jun 11 12:44:19.328007 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.327986 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-845d5d9dc5-8s4wm"] Jun 11 12:44:19.438874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.438841 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-openshift-service-ca\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.439022 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.438885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bdv9\" (UniqueName: \"kubernetes.io/projected/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-kube-api-access-6bdv9\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.439022 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.438967 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-maas-api-tls\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.539438 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.539408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-maas-api-tls\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.539621 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.539464 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-openshift-service-ca\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.539621 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.539497 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bdv9\" (UniqueName: \"kubernetes.io/projected/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-kube-api-access-6bdv9\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.540168 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.540147 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-openshift-service-ca\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.541868 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.541847 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-maas-api-tls\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.552675 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.552648 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bdv9\" (UniqueName: \"kubernetes.io/projected/6a60a3a7-ad0a-40ed-bec1-7c3cc965407f-kube-api-access-6bdv9\") pod \"maas-api-845d5d9dc5-8s4wm\" (UID: \"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f\") " pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.630228 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.630139 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:19.769256 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.769223 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-845d5d9dc5-8s4wm"] Jun 11 12:44:19.770892 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:44:19.770868 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a60a3a7_ad0a_40ed_bec1_7c3cc965407f.slice/crio-35dbcf6a1000508dbd8de96a0c94089a87286dc9acc424ea5c9dfff99405933e WatchSource:0}: Error finding container 35dbcf6a1000508dbd8de96a0c94089a87286dc9acc424ea5c9dfff99405933e: Status 404 returned error can't find the container with id 35dbcf6a1000508dbd8de96a0c94089a87286dc9acc424ea5c9dfff99405933e Jun 11 12:44:19.873470 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.873439 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-mpxbs"] Jun 11 12:44:19.878148 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.878127 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:44:19.882139 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.882073 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 12:44:19.882242 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.882198 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9j4st\"" Jun 11 12:44:19.887835 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.887813 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-mpxbs"] Jun 11 12:44:19.944096 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:19.944061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snhg8\" (UniqueName: \"kubernetes.io/projected/5b8eda42-d3d2-4a3e-9eec-26429e1f56be-kube-api-access-snhg8\") pod \"payload-processing-699b6cd6c-mpxbs\" (UID: \"5b8eda42-d3d2-4a3e-9eec-26429e1f56be\") " pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:44:20.044768 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:20.044734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snhg8\" (UniqueName: \"kubernetes.io/projected/5b8eda42-d3d2-4a3e-9eec-26429e1f56be-kube-api-access-snhg8\") pod \"payload-processing-699b6cd6c-mpxbs\" (UID: \"5b8eda42-d3d2-4a3e-9eec-26429e1f56be\") " pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:44:20.055499 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:20.055465 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snhg8\" (UniqueName: \"kubernetes.io/projected/5b8eda42-d3d2-4a3e-9eec-26429e1f56be-kube-api-access-snhg8\") pod \"payload-processing-699b6cd6c-mpxbs\" (UID: \"5b8eda42-d3d2-4a3e-9eec-26429e1f56be\") " pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:44:20.189975 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:20.189939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:44:20.339844 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:44:20.339804 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8eda42_d3d2_4a3e_9eec_26429e1f56be.slice/crio-11980093e82826d164c2f273f416bbc84482243bf045b6a5da8db047ffb1da0f WatchSource:0}: Error finding container 11980093e82826d164c2f273f416bbc84482243bf045b6a5da8db047ffb1da0f: Status 404 returned error can't find the container with id 11980093e82826d164c2f273f416bbc84482243bf045b6a5da8db047ffb1da0f Jun 11 12:44:20.340767 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:20.340744 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-mpxbs"] Jun 11 12:44:20.370024 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:20.369979 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" event={"ID":"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f","Type":"ContainerStarted","Data":"35dbcf6a1000508dbd8de96a0c94089a87286dc9acc424ea5c9dfff99405933e"} Jun 11 12:44:20.371179 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:20.371154 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" event={"ID":"5b8eda42-d3d2-4a3e-9eec-26429e1f56be","Type":"ContainerStarted","Data":"11980093e82826d164c2f273f416bbc84482243bf045b6a5da8db047ffb1da0f"} Jun 11 12:44:22.387519 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:22.387479 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" event={"ID":"6a60a3a7-ad0a-40ed-bec1-7c3cc965407f","Type":"ContainerStarted","Data":"324dde45ed924a1ba84dda3a7a779a7b50684282207a578a1b75e8165bdb88be"} Jun 11 12:44:22.388012 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:22.387592 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:22.406454 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:22.406399 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" podStartSLOduration=1.6301166550000001 podStartE2EDuration="3.406381434s" totalImagesPullingTime="1.776264779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:44:22.40571804 +0000 UTC m=+1390.859329139" watchObservedRunningTime="2026-06-11 12:44:22.406381434 +0000 UTC m=+1390.859992536" Jun 11 12:44:23.394358 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:23.394318 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" event={"ID":"5b8eda42-d3d2-4a3e-9eec-26429e1f56be","Type":"ContainerStarted","Data":"c41938aa5fca643940aadcbe1d91a1464612538d79a2cd38d3cfa756547cae0a"} Jun 11 12:44:23.394767 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:23.394564 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:44:23.415999 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:23.415955 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" podStartSLOduration=2.165365365 podStartE2EDuration="4.415940585s" totalImagesPullingTime="2.25057522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:44:23.415421361 +0000 UTC m=+1391.869032457" watchObservedRunningTime="2026-06-11 12:44:23.415940585 +0000 UTC m=+1391.869551704" Jun 11 12:44:28.400589 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:28.400556 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-845d5d9dc5-8s4wm" Jun 11 12:44:34.401289 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:44:34.401259 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-mpxbs" Jun 11 12:46:12.186063 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:12.186032 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:46:12.189592 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:12.189573 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:46:12.193864 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:12.193841 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:46:12.197121 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:12.197104 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5wtw_4a61bdef-01f0-46f1-bcf2-2356c7de8beb/ovn-acl-logging/0.log" Jun 11 12:46:50.222143 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:50.222110 2569 generic.go:356] "Generic (PLEG): container finished" podID="8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0" containerID="0a9c8b2aec67fabb1c6bb8fe9e0789ae4c0aa0b653130f5fa0df82645c5cbdce" exitCode=1 Jun 11 12:46:50.222578 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:50.222196 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" event={"ID":"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0","Type":"ContainerDied","Data":"0a9c8b2aec67fabb1c6bb8fe9e0789ae4c0aa0b653130f5fa0df82645c5cbdce"} Jun 11 12:46:50.222578 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:50.222532 2569 scope.go:117] "RemoveContainer" containerID="0a9c8b2aec67fabb1c6bb8fe9e0789ae4c0aa0b653130f5fa0df82645c5cbdce" Jun 11 12:46:50.749821 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:50.749786 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:46:50.977245 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:50.977206 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:46:51.229857 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:51.229816 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" event={"ID":"8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0","Type":"ContainerStarted","Data":"dc543166dd4005e8fd5d7f1e3b866337cb41c52cafecb17fbfe0f096e95c8054"} Jun 11 12:46:51.230266 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:46:51.229915 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:47:19.813584 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:19.813556 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ccf4c4b56-7zkrz_c5810227-19a6-4702-89d9-ed349649c2c9/nginx/0.log" Jun 11 12:47:20.054417 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:20.054372 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-h55kn_8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0/manager/1.log" Jun 11 12:47:20.166467 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:20.166439 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-w9rqw_bac8b8e8-dc03-4434-8ce4-18f64a52d065/manager/0.log" Jun 11 12:47:20.278910 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:20.278886 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-845d5d9dc5-8s4wm_6a60a3a7-ad0a-40ed-bec1-7c3cc965407f/maas-api/0.log" Jun 11 12:47:20.513941 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:20.513860 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5db5788859-lm9fc_2ceb292e-ca8c-47cb-b5f1-97406454e726/manager/0.log" Jun 11 12:47:20.626794 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:20.626764 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-7kwmw_89b82f85-981b-4729-8cb4-aba01ce78636/server/0.log" Jun 11 12:47:20.743176 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:20.743149 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bhvn4_091b3b06-e0f1-4c4e-bc01-177403a4a274/manager/0.log" Jun 11 12:47:21.092906 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.092876 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-sn8fv_303a7ef0-bbf7-4e26-9ffb-96d7409066bc/manager/0.log" Jun 11 12:47:21.099631 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.099612 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-sn8fv_303a7ef0-bbf7-4e26-9ffb-96d7409066bc/copy-manifests/0.log" Jun 11 12:47:21.426002 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.425968 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj"] Jun 11 12:47:21.436517 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.436477 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.440293 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.440262 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 12:47:21.440782 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.440762 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 12:47:21.442977 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.442953 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hfd94\"" Jun 11 12:47:21.443796 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.443111 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 12:47:21.446472 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.446444 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj"] Jun 11 12:47:21.582798 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.582763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mgpr\" (UniqueName: \"kubernetes.io/projected/5645b642-dbbe-4933-9c5f-19ecc58701d1-kube-api-access-9mgpr\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.582798 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.582799 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.582995 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.582817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.582995 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.582925 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.582995 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.582946 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5645b642-dbbe-4933-9c5f-19ecc58701d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.582995 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.582964 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.683890 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.683796 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgpr\" (UniqueName: \"kubernetes.io/projected/5645b642-dbbe-4933-9c5f-19ecc58701d1-kube-api-access-9mgpr\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.683890 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.683841 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.683890 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.683865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.684172 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.683913 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.684172 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.683951 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5645b642-dbbe-4933-9c5f-19ecc58701d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.684172 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.683967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.684375 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.684351 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.684432 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.684361 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.684432 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.684392 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.686059 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.686035 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5645b642-dbbe-4933-9c5f-19ecc58701d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.686386 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.686368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5645b642-dbbe-4933-9c5f-19ecc58701d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.698204 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.698174 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mgpr\" (UniqueName: \"kubernetes.io/projected/5645b642-dbbe-4933-9c5f-19ecc58701d1-kube-api-access-9mgpr\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj\" (UID: \"5645b642-dbbe-4933-9c5f-19ecc58701d1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.752293 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.752257 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" Jun 11 12:47:21.898688 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:21.898661 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj"] Jun 11 12:47:21.899758 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:47:21.899725 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5645b642_dbbe_4933_9c5f_19ecc58701d1.slice/crio-8de0afcb5879e201b91f5dc52de1342b16c4fd8ad66807c99e78fda0b26cfbc5 WatchSource:0}: Error finding container 8de0afcb5879e201b91f5dc52de1342b16c4fd8ad66807c99e78fda0b26cfbc5: Status 404 returned error can't find the container with id 8de0afcb5879e201b91f5dc52de1342b16c4fd8ad66807c99e78fda0b26cfbc5 Jun 11 12:47:22.013290 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.013211 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f_9f8eff1d-c3ae-4279-b1a2-5cb328350511/util/0.log" Jun 11 12:47:22.019690 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.019669 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f_9f8eff1d-c3ae-4279-b1a2-5cb328350511/pull/0.log" Jun 11 12:47:22.026254 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.026234 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f_9f8eff1d-c3ae-4279-b1a2-5cb328350511/extract/0.log" Jun 11 12:47:22.141145 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.141110 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r_2a06912a-f63e-4179-880e-33021856d51a/util/0.log" Jun 11 12:47:22.147915 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.147893 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r_2a06912a-f63e-4179-880e-33021856d51a/pull/0.log" Jun 11 12:47:22.154697 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.154682 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r_2a06912a-f63e-4179-880e-33021856d51a/extract/0.log" Jun 11 12:47:22.240562 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.240512 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-h55kn" Jun 11 12:47:22.282713 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.282632 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg_08768956-4f70-49d5-b81a-279d3078af32/util/0.log" Jun 11 12:47:22.308233 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.308196 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg_08768956-4f70-49d5-b81a-279d3078af32/pull/0.log" Jun 11 12:47:22.322053 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.322024 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg_08768956-4f70-49d5-b81a-279d3078af32/extract/0.log" Jun 11 12:47:22.408478 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.408440 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" event={"ID":"5645b642-dbbe-4933-9c5f-19ecc58701d1","Type":"ContainerStarted","Data":"8de0afcb5879e201b91f5dc52de1342b16c4fd8ad66807c99e78fda0b26cfbc5"} Jun 11 12:47:22.430760 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.430730 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw_c6a5f759-80a3-4edc-a322-531f5628501b/util/0.log" Jun 11 12:47:22.442510 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.442476 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw_c6a5f759-80a3-4edc-a322-531f5628501b/pull/0.log" Jun 11 12:47:22.451472 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:22.451445 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw_c6a5f759-80a3-4edc-a322-531f5628501b/extract/0.log" Jun 11 12:47:23.117915 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:23.117877 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5j56x_1cdce10c-65cf-465e-bc25-ea0bea5005a0/manager/0.log" Jun 11 12:47:23.337667 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:23.337635 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9888d_92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63/manager/0.log" Jun 11 12:47:23.819592 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:23.819563 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ckfhp_cf1c862e-1cba-4409-8793-913fac451f97/discovery/0.log" Jun 11 12:47:24.063288 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:24.063229 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45d4496f-ss9m7_74d20a1d-80e9-4973-9cba-2e0baa5f25a7/kube-auth-proxy/0.log" Jun 11 12:47:24.897876 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:24.897837 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-mpxbs_5b8eda42-d3d2-4a3e-9eec-26429e1f56be/payload-processing/0.log" Jun 11 12:47:25.006297 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:25.006270 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dcf8c4d4f-g2kcl_568bbb4d-94a7-4257-a01a-4c87703a586c/router/0.log" Jun 11 12:47:26.434329 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:26.434287 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-v95fj" event={"ID":"5645b642-dbbe-4933-9c5f-19ecc58701d1","Type":"ContainerStarted","Data":"a36f9b7cbfedffcd1148192d031d7085706b40af27f7494410199bea348e1570"} Jun 11 12:47:32.526792 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:32.526734 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rdt4q_d7f61177-3d0e-49e2-9800-2a9e1c7fac17/global-pull-secret-syncer/0.log" Jun 11 12:47:32.727356 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:32.727323 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vvcmm_830001bf-208d-4991-8162-45e60d6c4314/konnectivity-agent/0.log" Jun 11 12:47:32.754078 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:32.754056 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-239.ec2.internal_3c458f95fdad97edba52b10af4af06ea/haproxy/0.log" Jun 11 12:47:35.536128 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:35.536098 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-njc5n_4784790b-e108-4f95-9376-5ccf3da9a48e/sail-operator/0.log" Jun 11 12:47:36.516987 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.516955 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f_9f8eff1d-c3ae-4279-b1a2-5cb328350511/extract/0.log" Jun 11 12:47:36.556660 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.556622 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f_9f8eff1d-c3ae-4279-b1a2-5cb328350511/util/0.log" Jun 11 12:47:36.584898 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.584872 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcf8f_9f8eff1d-c3ae-4279-b1a2-5cb328350511/pull/0.log" Jun 11 12:47:36.633278 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.633244 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r_2a06912a-f63e-4179-880e-33021856d51a/extract/0.log" Jun 11 12:47:36.679120 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.679095 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r_2a06912a-f63e-4179-880e-33021856d51a/util/0.log" Jun 11 12:47:36.705359 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.705337 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09t78r_2a06912a-f63e-4179-880e-33021856d51a/pull/0.log" Jun 11 12:47:36.766639 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.766614 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg_08768956-4f70-49d5-b81a-279d3078af32/extract/0.log" Jun 11 12:47:36.795701 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.795632 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg_08768956-4f70-49d5-b81a-279d3078af32/util/0.log" Jun 11 12:47:36.828909 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.828890 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f96sg_08768956-4f70-49d5-b81a-279d3078af32/pull/0.log" Jun 11 12:47:36.896697 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.896671 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw_c6a5f759-80a3-4edc-a322-531f5628501b/extract/0.log" Jun 11 12:47:36.937243 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.937213 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw_c6a5f759-80a3-4edc-a322-531f5628501b/util/0.log" Jun 11 12:47:36.986491 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:36.986457 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnvgw_c6a5f759-80a3-4edc-a322-531f5628501b/pull/0.log" Jun 11 12:47:37.290612 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:37.290574 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5j56x_1cdce10c-65cf-465e-bc25-ea0bea5005a0/manager/0.log" Jun 11 12:47:37.403208 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:37.403182 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9888d_92e9c0ae-ba69-4a90-b3cf-e6ac7fd43a63/manager/0.log" Jun 11 12:47:39.393336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:39.393308 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7pwl8_c8e1e3e1-678a-4536-9383-a6faede09b50/kube-state-metrics/0.log" Jun 11 12:47:39.436189 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:39.436165 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7pwl8_c8e1e3e1-678a-4536-9383-a6faede09b50/kube-rbac-proxy-main/0.log" Jun 11 12:47:39.507288 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:39.507265 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7pwl8_c8e1e3e1-678a-4536-9383-a6faede09b50/kube-rbac-proxy-self/0.log" Jun 11 12:47:40.118730 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:40.118705 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm98p_5a34a99f-3c54-4adf-9c10-bb2692340d3b/node-exporter/0.log" Jun 11 12:47:40.178047 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:40.178023 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm98p_5a34a99f-3c54-4adf-9c10-bb2692340d3b/kube-rbac-proxy/0.log" Jun 11 12:47:40.243290 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:40.243262 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm98p_5a34a99f-3c54-4adf-9c10-bb2692340d3b/init-textfile/0.log" Jun 11 12:47:40.285766 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:40.285747 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nbr5s_1a6fe3e8-46c4-42b0-be71-38a177a60f00/kube-rbac-proxy-main/0.log" Jun 11 12:47:40.355555 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:40.355513 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nbr5s_1a6fe3e8-46c4-42b0-be71-38a177a60f00/kube-rbac-proxy-self/0.log" Jun 11 12:47:40.397418 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:40.397341 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nbr5s_1a6fe3e8-46c4-42b0-be71-38a177a60f00/openshift-state-metrics/0.log" Jun 11 12:47:42.675514 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.675476 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s"] Jun 11 12:47:42.679625 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.679596 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.682500 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.682476 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q577s\"/\"openshift-service-ca.crt\"" Jun 11 12:47:42.682638 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.682560 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q577s\"/\"default-dockercfg-hkx79\"" Jun 11 12:47:42.683769 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.683750 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q577s\"/\"kube-root-ca.crt\"" Jun 11 12:47:42.720287 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.720264 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s"] Jun 11 12:47:42.873738 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.873696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm4nx\" (UniqueName: \"kubernetes.io/projected/62df5506-61ea-42c0-9d1c-8b38bf062ef6-kube-api-access-dm4nx\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.873927 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.873752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-lib-modules\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.873927 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.873815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-proc\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.873927 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.873846 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-sys\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.873927 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.873919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-podres\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975250 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-podres\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975298 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm4nx\" (UniqueName: \"kubernetes.io/projected/62df5506-61ea-42c0-9d1c-8b38bf062ef6-kube-api-access-dm4nx\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975319 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-lib-modules\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975336 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975337 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-proc\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975692 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975352 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-sys\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975692 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975432 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-podres\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975692 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975452 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-sys\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975692 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975432 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-lib-modules\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.975692 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.975436 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62df5506-61ea-42c0-9d1c-8b38bf062ef6-proc\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.988688 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.988659 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm4nx\" (UniqueName: \"kubernetes.io/projected/62df5506-61ea-42c0-9d1c-8b38bf062ef6-kube-api-access-dm4nx\") pod \"perf-node-gather-daemonset-bth2s\" (UID: \"62df5506-61ea-42c0-9d1c-8b38bf062ef6\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:42.990597 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:42.990568 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:43.165383 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.165356 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s"] Jun 11 12:47:43.166047 ip-10-0-132-239 kubenswrapper[2569]: W0611 12:47:43.166023 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62df5506_61ea_42c0_9d1c_8b38bf062ef6.slice/crio-56f9af736d01977109ad59148927474cfd34617f410bdf546940dda3412e1b80 WatchSource:0}: Error finding container 56f9af736d01977109ad59148927474cfd34617f410bdf546940dda3412e1b80: Status 404 returned error can't find the container with id 56f9af736d01977109ad59148927474cfd34617f410bdf546940dda3412e1b80 Jun 11 12:47:43.529053 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.528966 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" event={"ID":"62df5506-61ea-42c0-9d1c-8b38bf062ef6","Type":"ContainerStarted","Data":"94c97c26ce3bc501b041dce3793e4ee819972a2b2c2e7cb55a2ddef69be59dd7"} Jun 11 12:47:43.529053 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.529045 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:43.529246 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.529071 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" event={"ID":"62df5506-61ea-42c0-9d1c-8b38bf062ef6","Type":"ContainerStarted","Data":"56f9af736d01977109ad59148927474cfd34617f410bdf546940dda3412e1b80"} Jun 11 12:47:43.568055 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.567999 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" podStartSLOduration=1.567984171 podStartE2EDuration="1.567984171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:47:43.56617467 +0000 UTC m=+1592.019785767" watchObservedRunningTime="2026-06-11 12:47:43.567984171 +0000 UTC m=+1592.021595267" Jun 11 12:47:43.791490 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.791409 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/1.log" Jun 11 12:47:43.799559 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:43.799511 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-w9nrd_d22c5d13-629e-409c-9164-99b1bcee4e74/console-operator/2.log" Jun 11 12:47:44.561575 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:44.561535 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fb667b94b-7t8hc_95f34a27-9b82-4991-b94c-6393560750e5/console/0.log" Jun 11 12:47:44.643179 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:44.643150 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-vs7mj_2e8ea4f0-2e8b-4d00-9657-38bae23b0dc8/download-server/0.log" Jun 11 12:47:45.456812 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:45.456783 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-dfdpg_75360e33-18e8-40af-9483-dffbf4abca3c/volume-data-source-validator/0.log" Jun 11 12:47:46.773368 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:46.773337 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx46k_46516883-21ad-428c-8a85-e00eae76091a/dns/0.log" Jun 11 12:47:46.814010 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:46.813975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx46k_46516883-21ad-428c-8a85-e00eae76091a/kube-rbac-proxy/0.log" Jun 11 12:47:46.983078 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:46.983046 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xj49p_916fca5e-e135-4925-bf87-5ba50b1e3925/dns-node-resolver/0.log" Jun 11 12:47:47.792706 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:47.792673 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ck4gh_f88c2ec3-858c-4985-88a4-a7521051c799/node-ca/0.log" Jun 11 12:47:49.058954 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:49.058924 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ckfhp_cf1c862e-1cba-4409-8793-913fac451f97/discovery/0.log" Jun 11 12:47:49.188993 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:49.188966 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45d4496f-ss9m7_74d20a1d-80e9-4973-9cba-2e0baa5f25a7/kube-auth-proxy/0.log" Jun 11 12:47:49.389000 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:49.388926 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-mpxbs_5b8eda42-d3d2-4a3e-9eec-26429e1f56be/payload-processing/0.log" Jun 11 12:47:49.459919 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:49.459884 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dcf8c4d4f-g2kcl_568bbb4d-94a7-4257-a01a-4c87703a586c/router/0.log" Jun 11 12:47:49.545091 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:49.545066 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-bth2s" Jun 11 12:47:50.478294 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:50.478266 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlp8h_155e8c42-7549-4683-a139-449cfff8da9b/serve-healthcheck-canary/0.log" Jun 11 12:47:51.812034 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:51.811986 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7spq_0fa7946e-1e94-47e2-bce5-0c4534190b9c/kube-rbac-proxy/0.log" Jun 11 12:47:51.910002 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:51.909974 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7spq_0fa7946e-1e94-47e2-bce5-0c4534190b9c/exporter/0.log" Jun 11 12:47:52.002379 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:52.002349 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7spq_0fa7946e-1e94-47e2-bce5-0c4534190b9c/extractor/0.log" Jun 11 12:47:56.647061 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:56.647034 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ccf4c4b56-7zkrz_c5810227-19a6-4702-89d9-ed349649c2c9/nginx/0.log" Jun 11 12:47:56.751110 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:56.751070 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-h55kn_8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0/manager/1.log" Jun 11 12:47:56.751276 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:56.751158 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-h55kn_8de8a99e-b9a0-4df5-b62a-1ed91e49e4b0/manager/0.log" Jun 11 12:47:56.787084 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:56.787049 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-w9rqw_bac8b8e8-dc03-4434-8ce4-18f64a52d065/manager/0.log" Jun 11 12:47:56.827651 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:56.827617 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-845d5d9dc5-8s4wm_6a60a3a7-ad0a-40ed-bec1-7c3cc965407f/maas-api/0.log" Jun 11 12:47:56.970020 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:56.969991 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5db5788859-lm9fc_2ceb292e-ca8c-47cb-b5f1-97406454e726/manager/0.log" Jun 11 12:47:57.083941 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.083909 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ckfhp_cf1c862e-1cba-4409-8793-913fac451f97/discovery/0.log" Jun 11 12:47:57.087316 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.087292 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-7kwmw_89b82f85-981b-4729-8cb4-aba01ce78636/server/0.log" Jun 11 12:47:57.131662 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.131633 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45d4496f-ss9m7_74d20a1d-80e9-4973-9cba-2e0baa5f25a7/kube-auth-proxy/0.log" Jun 11 12:47:57.155340 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.155310 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bhvn4_091b3b06-e0f1-4c4e-bc01-177403a4a274/manager/0.log" Jun 11 12:47:57.222473 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.222386 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-mpxbs_5b8eda42-d3d2-4a3e-9eec-26429e1f56be/payload-processing/0.log" Jun 11 12:47:57.270401 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.270378 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dcf8c4d4f-g2kcl_568bbb4d-94a7-4257-a01a-4c87703a586c/router/0.log" Jun 11 12:47:57.443463 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.443435 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-sn8fv_303a7ef0-bbf7-4e26-9ffb-96d7409066bc/manager/0.log" Jun 11 12:47:57.492356 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:57.492277 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-sn8fv_303a7ef0-bbf7-4e26-9ffb-96d7409066bc/copy-manifests/0.log" Jun 11 12:47:58.443820 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:58.443790 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ckfhp_cf1c862e-1cba-4409-8793-913fac451f97/discovery/0.log" Jun 11 12:47:58.539583 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:58.539537 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45d4496f-ss9m7_74d20a1d-80e9-4973-9cba-2e0baa5f25a7/kube-auth-proxy/0.log" Jun 11 12:47:58.612526 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:58.612494 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-mpxbs_5b8eda42-d3d2-4a3e-9eec-26429e1f56be/payload-processing/0.log" Jun 11 12:47:58.640300 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:58.640268 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dcf8c4d4f-g2kcl_568bbb4d-94a7-4257-a01a-4c87703a586c/router/0.log" Jun 11 12:47:59.311840 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.311808 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d5rkl_fc7c8b99-eae9-4309-8184-d0618dd9ddfe/openshift-lws-operator/0.log" Jun 11 12:47:59.411378 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.411339 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8"] Jun 11 12:47:59.438874 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.438836 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8"] Jun 11 12:47:59.439069 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.438946 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.442188 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.442160 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 12:47:59.522617 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.522583 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.522617 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.522620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.523004 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.522666 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.523004 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.522687 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.523004 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.522710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s88g\" (UniqueName: \"kubernetes.io/projected/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-kube-api-access-8s88g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.523004 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.522742 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623451 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623368 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s88g\" (UniqueName: \"kubernetes.io/projected/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-kube-api-access-8s88g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623451 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623682 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623682 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623601 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623682 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623679 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623798 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623841 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623817 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.623908 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.623891 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.624035 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.624019 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.625883 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.625863 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.626195 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.626177 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.633887 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.633863 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s88g\" (UniqueName: \"kubernetes.io/projected/a5b49a94-76f8-4f0d-9ef4-fa0d049e375c-kube-api-access-8s88g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8\" (UID: \"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.751098 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.751063 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" Jun 11 12:47:59.906500 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:47:59.906466 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8"] Jun 11 12:48:00.415231 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:48:00.415200 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ckfhp_cf1c862e-1cba-4409-8793-913fac451f97/discovery/0.log" Jun 11 12:48:00.448432 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:48:00.448406 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45d4496f-ss9m7_74d20a1d-80e9-4973-9cba-2e0baa5f25a7/kube-auth-proxy/0.log" Jun 11 12:48:00.507129 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:48:00.507098 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-mpxbs_5b8eda42-d3d2-4a3e-9eec-26429e1f56be/payload-processing/0.log" Jun 11 12:48:00.528612 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:48:00.528588 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dcf8c4d4f-g2kcl_568bbb4d-94a7-4257-a01a-4c87703a586c/router/0.log" Jun 11 12:48:00.628925 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:48:00.628837 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" event={"ID":"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c","Type":"ContainerStarted","Data":"6406718ec5906f4c50115a56451d79e904b67a2c13e69a22b2c8abb4dd322477"} Jun 11 12:48:00.628925 ip-10-0-132-239 kubenswrapper[2569]: I0611 12:48:00.628905 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-8w5w8" event={"ID":"a5b49a94-76f8-4f0d-9ef4-fa0d049e375c","Type":"ContainerStarted","Data":"995387fcb3d3d205a869777510a52a9bca27ebad3e909d45170434f80aabe429"}