Jun 11 23:07:40.525766 ip-10-0-143-190 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 23:07:40.525897 ip-10-0-143-190 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 23:07:40.526009 ip-10-0-143-190 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 23:07:40.526445 ip-10-0-143-190 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 23:07:50.545331 ip-10-0-143-190 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 23:07:50.545348 ip-10-0-143-190 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5008392ad4fa4fec8fcc2e210112377f -- Jun 11 23:10:01.784838 ip-10-0-143-190 systemd[1]: Starting Kubernetes Kubelet... Jun 11 23:10:02.238278 ip-10-0-143-190 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:10:02.238278 ip-10-0-143-190 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 23:10:02.238278 ip-10-0-143-190 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:10:02.238278 ip-10-0-143-190 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 23:10:02.238278 ip-10-0-143-190 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:10:02.239147 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.239062 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 23:10:02.243644 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243628 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:02.243644 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243642 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:02.243644 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243646 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243650 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243654 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243657 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243659 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243662 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243665 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243667 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243670 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243674 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243676 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243679 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243682 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243684 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243687 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243690 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243692 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243695 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243698 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:02.243739 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243700 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243703 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243705 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243708 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243710 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243713 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243715 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243718 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243720 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243722 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243725 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243727 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243730 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243732 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243735 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243738 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243741 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243744 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243746 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243749 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:02.244218 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243752 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243755 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243757 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243760 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243762 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243766 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243768 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243771 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243774 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243776 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243779 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243781 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243784 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243786 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243789 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243791 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243794 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243796 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243799 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243801 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:02.244718 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243804 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243806 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243809 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243813 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243817 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243821 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243824 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243828 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243831 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243834 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243844 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243847 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243851 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243854 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243856 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243859 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243862 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243865 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:02.245196 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243870 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243873 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243875 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243878 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243881 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243883 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243885 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243888 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243890 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243893 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243895 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243898 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243900 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243904 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243906 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243909 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243912 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243915 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243917 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:02.245657 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.243919 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245197 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245205 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245208 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245211 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245214 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245217 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245221 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245223 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245228 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245231 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245234 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245237 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245240 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245243 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245245 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245248 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245250 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245253 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:02.246106 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245255 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245258 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245260 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245263 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245265 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245268 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245270 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245273 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245276 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245279 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245281 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245284 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245286 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245288 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245291 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245294 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245296 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245298 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245301 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245304 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:02.246616 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245307 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245309 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245312 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245314 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245317 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245320 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245322 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245324 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245327 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245329 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245332 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245334 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245336 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245339 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245342 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245344 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245346 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245350 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245352 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245355 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:02.247178 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245358 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245360 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245363 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245365 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245368 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245370 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245373 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245375 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245377 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245380 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245393 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245396 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245399 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245402 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245405 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245407 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245410 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245412 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245415 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245418 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:02.247682 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245420 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245423 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245425 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245428 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245432 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245435 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245439 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245441 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245444 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245447 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245450 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245453 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245455 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245458 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245460 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245463 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245466 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245470 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245473 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:02.248181 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245475 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245478 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245874 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245880 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245883 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245886 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245889 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245892 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245894 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245898 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245901 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245903 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245906 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245908 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245911 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245914 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245917 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245919 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245922 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245924 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:02.248652 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245927 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245930 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245932 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245935 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245938 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245940 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245943 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245945 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245948 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245950 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245954 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245958 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245961 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245964 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245966 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245969 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245971 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245974 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245976 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245979 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:02.249167 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245982 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245984 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245987 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245989 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245991 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245994 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245997 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.245999 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246002 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246005 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246009 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246012 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246015 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246017 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246020 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246023 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246025 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246027 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246030 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246032 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:02.249688 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246035 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246037 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246040 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246042 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246044 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246047 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246049 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246052 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246056 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246059 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246061 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246064 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246067 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246070 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246072 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246074 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246077 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246079 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246082 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:02.250166 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246085 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246088 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246090 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246093 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246095 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246098 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246100 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246102 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246105 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246107 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246110 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246112 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246115 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246118 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246120 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246123 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246125 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246128 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246130 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246133 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:02.250662 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246135 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246137 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246199 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246206 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246212 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246216 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246221 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246224 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246228 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246234 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246239 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246243 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246248 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246252 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246257 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246262 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246266 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246269 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246271 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246274 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246278 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246281 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246284 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246287 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 23:10:02.251141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246290 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246294 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246298 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246301 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246305 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246308 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246310 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246313 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246316 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246319 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246323 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246326 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246328 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246331 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246334 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246337 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246341 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246348 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246351 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246354 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246356 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246360 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246363 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246366 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246369 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 23:10:02.251750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246372 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246375 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246377 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246380 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246383 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246387 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246390 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246393 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246396 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246399 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246402 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246404 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246407 2581 flags.go:64] FLAG: --help="false" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246410 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246413 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246415 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246418 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246421 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246425 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246427 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246430 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246432 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246435 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 23:10:02.252335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246438 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246443 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246446 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246448 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246451 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246454 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246457 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246459 2581 flags.go:64] FLAG: --lock-file="" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246462 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246464 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246467 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246472 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246475 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246477 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246485 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246488 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246491 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246494 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246496 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246501 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246504 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246519 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246522 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246524 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246527 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 23:10:02.252918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246530 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246533 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246536 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246539 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246545 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246548 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246551 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246554 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246573 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246582 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246585 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246588 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246591 2581 flags.go:64] FLAG: --port="10250" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246594 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246596 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb9d27f310e6a272" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246599 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246602 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246605 2581 flags.go:64] FLAG: --register-node="true" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246608 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246611 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246614 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246618 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246621 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246624 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246627 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 23:10:02.253524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246630 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246633 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246636 2581 flags.go:64] FLAG: --runonce="false" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246639 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246641 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246644 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246647 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246650 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246653 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246656 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246658 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246661 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246664 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246667 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246670 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246673 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246684 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246686 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246691 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246694 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246697 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246700 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246703 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246706 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246709 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 23:10:02.254179 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246711 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246714 2581 flags.go:64] FLAG: --v="2" Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246718 2581 flags.go:64] FLAG: --version="false" Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246723 2581 flags.go:64] FLAG: --vmodule="" Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246727 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.246730 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246840 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246844 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246847 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246849 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246852 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246855 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246858 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246861 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246865 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246869 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246872 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246875 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246877 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246880 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:02.254800 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246882 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246885 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246887 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246891 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246894 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246897 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246900 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246902 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246906 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246909 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246912 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246915 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246917 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246920 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246922 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246926 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246929 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246931 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246934 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:02.255271 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246936 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246939 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246941 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246944 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246947 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246949 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246952 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246954 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246956 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246959 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246962 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246965 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246967 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246970 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246972 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246975 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246978 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246981 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246984 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246987 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:02.255765 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246989 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246992 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246994 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.246998 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247001 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247004 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247007 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247009 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247013 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247015 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247018 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247020 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247022 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247025 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247028 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247030 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247032 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247036 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247038 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247041 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:02.256230 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247043 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247045 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247048 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247050 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247053 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247055 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247058 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247061 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247064 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247067 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247069 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247072 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247074 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247077 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247079 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247082 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247084 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247087 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247089 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247092 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:02.256709 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247095 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247097 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247100 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247102 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247105 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.247107 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.247790 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.254705 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.254718 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.254734 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.254742 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254811 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254816 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254820 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254823 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:02.257204 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254826 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254828 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254831 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254834 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254836 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254838 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254841 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254844 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254847 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254850 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254854 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254858 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254861 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254864 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254866 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254869 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254871 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254874 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254877 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254879 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:02.257604 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254882 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254884 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254887 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254890 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254892 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254896 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254898 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254901 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254903 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254906 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254909 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254912 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254914 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254917 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254919 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254922 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254924 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254927 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254929 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254932 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:02.258091 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254934 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254938 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254941 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254943 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254946 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254948 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254951 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254953 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254956 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254958 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254961 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254963 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254966 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254968 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254970 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254973 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254975 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254978 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254981 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:02.258580 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254984 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254986 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254989 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254991 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254994 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254997 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.254999 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255002 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255004 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255006 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255009 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255011 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255014 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255016 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255019 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255022 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255026 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255029 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255033 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:02.259031 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255036 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255039 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255042 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255044 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255047 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255049 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255052 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255055 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255057 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255059 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255062 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255064 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255067 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255070 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255072 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255074 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:02.259494 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255077 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.255082 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255190 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255195 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255197 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255200 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255203 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255205 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255208 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255210 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255213 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255215 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255218 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255221 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255223 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:02.259885 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255226 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255228 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255231 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255233 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255235 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255238 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255240 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255242 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255245 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255247 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255250 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255253 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255256 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255259 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255262 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255264 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255266 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255269 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255271 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255274 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:02.260247 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255277 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255279 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255282 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255284 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255287 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255289 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255292 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255294 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255296 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255299 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255301 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255304 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255307 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255309 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255312 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255314 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255316 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255319 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255321 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255323 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:02.260726 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255326 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255328 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255331 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255333 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255335 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255338 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255340 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255342 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255344 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255347 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255350 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255352 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255355 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255357 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255361 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255364 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255367 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255370 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255372 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255375 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:02.261188 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255378 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255380 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255383 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255386 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255389 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255391 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255394 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255396 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255398 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255401 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255403 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255406 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255408 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255411 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255413 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255417 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255420 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255423 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255426 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:02.261901 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255428 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255431 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255433 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255436 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255438 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255440 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:02.255443 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.255448 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.255532 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.258256 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.259676 2581 server.go:1019] "Starting client certificate rotation" Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.259791 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:10:02.262528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.259827 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:10:02.265948 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.265932 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:10:02.267022 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.267004 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:10:02.280767 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.280749 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 23:10:02.284031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.284013 2581 log.go:25] "Validated CRI v1 image API" Jun 11 23:10:02.285671 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.285656 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 23:10:02.288154 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.288136 2581 fs.go:135] Filesystem UUIDs: map[0136ddcc-5f30-4966-a262-1f038777690d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7d012208-7d89-4603-a7ce-12e39c8be945:/dev/nvme0n1p4] Jun 11 23:10:02.288209 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.288155 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 23:10:02.294924 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.294821 2581 manager.go:216] Machine: {Timestamp:2026-06-11 23:10:02.292321979 +0000 UTC m=+0.378248533 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099421 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f738a32660d4c3a265d425ce07f6 SystemUUID:ec20f738-a326-60d4-c3a2-65d425ce07f6 BootID:5008392a-d4fa-4fec-8fcc-2e210112377f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:60:98:50:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:60:98:50:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:20:54:0b:e2:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 23:10:02.294924 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.294921 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 23:10:02.295053 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.295013 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 23:10:02.297974 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.297945 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 23:10:02.298105 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.297977 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 23:10:02.298971 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.298962 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 23:10:02.299006 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.299001 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 23:10:02.299040 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.299010 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:10:02.299169 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.299150 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:10:02.299933 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.299921 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:10:02.301553 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.301542 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 23:10:02.305690 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305678 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:10:02.305847 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305837 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 23:10:02.305879 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305869 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 23:10:02.305912 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305889 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 23:10:02.305940 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305912 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 23:10:02.305940 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305924 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 23:10:02.305940 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.305936 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 23:10:02.306409 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.306398 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:10:02.306443 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.306416 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:10:02.309352 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.309335 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 23:10:02.311056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311042 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 23:10:02.311101 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311073 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 23:10:02.311214 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311205 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 23:10:02.311247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311220 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 23:10:02.311247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311226 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 23:10:02.311247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311231 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 23:10:02.311321 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311249 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 23:10:02.311321 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.311255 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 23:10:02.317791 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.317765 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 23:10:02.317791 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.317790 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 23:10:02.317941 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.317800 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 23:10:02.317941 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.317808 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 23:10:02.317941 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.317832 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 23:10:02.317941 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.317845 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 23:10:02.319754 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.319742 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 23:10:02.319812 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.319756 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 23:10:02.323444 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.323426 2581 server.go:1268] "Started kubelet" Jun 11 23:10:02.323838 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.323767 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 23:10:02.324137 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.324052 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 23:10:02.324137 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.324132 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 23:10:02.324400 ip-10-0-143-190 systemd[1]: Started Kubernetes Kubelet. Jun 11 23:10:02.325407 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.325169 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 23:10:02.325407 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.325356 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 23:10:02.325407 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.325367 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 23:10:02.326386 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.326364 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 23:10:02.330235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.330218 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 23:10:02.333783 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.333764 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 23:10:02.334605 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.333623 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-190.ec2.internal.18b8299bee84d1e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-190.ec2.internal,UID:ip-10-0-143-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-190.ec2.internal,},FirstTimestamp:2026-06-11 23:10:02.323382759 +0000 UTC m=+0.409309312,LastTimestamp:2026-06-11 23:10:02.323382759 +0000 UTC m=+0.409309312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-190.ec2.internal,}" Jun 11 23:10:02.335863 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.335841 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 23:10:02.335965 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.335847 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 23:10:02.336028 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.335998 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.336577 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.336537 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 23:10:02.336670 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.336540 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 23:10:02.336670 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.336596 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 23:10:02.336783 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.336725 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 23:10:02.336783 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.336732 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 23:10:02.337139 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337122 2581 factory.go:55] Registering systemd factory Jun 11 23:10:02.337220 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337164 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 23:10:02.337448 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337432 2581 factory.go:153] Registering CRI-O factory Jun 11 23:10:02.337506 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337452 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 23:10:02.337538 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337505 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 23:10:02.337538 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337529 2581 factory.go:103] Registering Raw factory Jun 11 23:10:02.337628 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337544 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 23:10:02.337966 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.337952 2581 manager.go:349] Starting recovery of all containers Jun 11 23:10:02.342183 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.342158 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vgpf" Jun 11 23:10:02.347586 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.347545 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 23:10:02.347712 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.347687 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 23:10:02.348930 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.348914 2581 manager.go:354] Recovery completed Jun 11 23:10:02.352753 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.352740 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.354021 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.353998 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vgpf" Jun 11 23:10:02.355386 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.355370 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.355458 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.355401 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.355458 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.355411 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.356872 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.356854 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 23:10:02.356872 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.356865 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.357000 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.356870 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 23:10:02.357000 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.356941 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:10:02.357542 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.357527 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.357660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.357551 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.357660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.357584 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.358811 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.358799 2581 policy_none.go:49] "None policy: Start" Jun 11 23:10:02.358861 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.358814 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 23:10:02.358861 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.358824 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 23:10:02.360505 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.360491 2581 policy_none.go:47] "Start" Jun 11 23:10:02.397151 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397138 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.397171 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397181 2581 server.go:87] "Starting device plugin registration server" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397439 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397454 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397543 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397629 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.397639 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.398295 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.398340 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.402530 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.403809 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.403851 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.403876 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.403946 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 23:10:02.412485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.406148 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:02.498299 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.498239 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.499044 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.499025 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.499129 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.499062 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.499129 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.499072 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.499129 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.499092 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.504338 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.504323 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal"] Jun 11 23:10:02.504381 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.504372 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.505019 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.505006 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.505081 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.505030 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.505081 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.505041 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.505223 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.505212 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.505255 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.505229 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-190.ec2.internal\": node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.507216 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507205 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.507328 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.507367 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507333 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.507867 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507850 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.507927 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507878 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.507927 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507887 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.507989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507855 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.507989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507951 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.507989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.507961 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.509923 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.509896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.509923 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.509923 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:02.510605 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.510589 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:02.510749 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.510615 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:02.510749 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.510630 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:02.523184 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.523169 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.535077 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.535057 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-190.ec2.internal\" not found" node="ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.537059 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.537041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92a9fbefb60d8cd75a07802386812876-config\") pod \"kube-apiserver-proxy-ip-10-0-143-190.ec2.internal\" (UID: \"92a9fbefb60d8cd75a07802386812876\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.537143 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.537070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f9f10ff7554a468a59d8d8df982b08b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal\" (UID: \"0f9f10ff7554a468a59d8d8df982b08b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.537143 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.537096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f9f10ff7554a468a59d8d8df982b08b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal\" (UID: \"0f9f10ff7554a468a59d8d8df982b08b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.539327 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.539312 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-190.ec2.internal\" not found" node="ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.623983 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.623951 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.637287 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.637261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92a9fbefb60d8cd75a07802386812876-config\") pod \"kube-apiserver-proxy-ip-10-0-143-190.ec2.internal\" (UID: \"92a9fbefb60d8cd75a07802386812876\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.637397 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.637298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f9f10ff7554a468a59d8d8df982b08b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal\" (UID: \"0f9f10ff7554a468a59d8d8df982b08b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.637397 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.637322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f9f10ff7554a468a59d8d8df982b08b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal\" (UID: \"0f9f10ff7554a468a59d8d8df982b08b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.637397 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.637376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92a9fbefb60d8cd75a07802386812876-config\") pod \"kube-apiserver-proxy-ip-10-0-143-190.ec2.internal\" (UID: \"92a9fbefb60d8cd75a07802386812876\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.637517 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.637376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f9f10ff7554a468a59d8d8df982b08b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal\" (UID: \"0f9f10ff7554a468a59d8d8df982b08b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.637517 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.637376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f9f10ff7554a468a59d8d8df982b08b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal\" (UID: \"0f9f10ff7554a468a59d8d8df982b08b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.724512 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.724460 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.825259 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.825177 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:02.838571 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.838535 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.844643 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:02.844518 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:02.925317 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:02.925268 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.025859 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.025815 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.126335 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.126271 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.226877 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.226846 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.259305 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.259284 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 23:10:03.259808 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.259424 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:10:03.327805 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.327786 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.359853 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.359822 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:05:02 +0000 UTC" deadline="2028-01-01 23:25:11.203457846 +0000 UTC" Jun 11 23:10:03.359853 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.359851 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13656h15m7.843610505s" Jun 11 23:10:03.427888 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.427858 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.428148 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:03.428122 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a9fbefb60d8cd75a07802386812876.slice/crio-d5a9014f9f88fe0cd9f8f15dd8a4851e85f7da945a4b2a839c6593a9820fe639 WatchSource:0}: Error finding container d5a9014f9f88fe0cd9f8f15dd8a4851e85f7da945a4b2a839c6593a9820fe639: Status 404 returned error can't find the container with id d5a9014f9f88fe0cd9f8f15dd8a4851e85f7da945a4b2a839c6593a9820fe639 Jun 11 23:10:03.432178 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.432161 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:10:03.461497 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.461473 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:03.528348 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.528313 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.562887 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:03.562864 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9f10ff7554a468a59d8d8df982b08b.slice/crio-84fb8e58a822046919e433e17ab0dbaf5f4887a36aaa1c48cc51fd19fe9f55b7 WatchSource:0}: Error finding container 84fb8e58a822046919e433e17ab0dbaf5f4887a36aaa1c48cc51fd19fe9f55b7: Status 404 returned error can't find the container with id 84fb8e58a822046919e433e17ab0dbaf5f4887a36aaa1c48cc51fd19fe9f55b7 Jun 11 23:10:03.625042 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.625022 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:03.628844 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:03.628820 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-190.ec2.internal\" not found" Jun 11 23:10:03.629694 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.629681 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:03.636247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.636232 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" Jun 11 23:10:03.645675 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.645652 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:10:03.646985 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.646973 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" Jun 11 23:10:03.657619 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:03.657603 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:10:04.307064 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.307040 2581 apiserver.go:52] "Watching apiserver" Jun 11 23:10:04.316514 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.316490 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 23:10:04.316961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.316936 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-cjgvx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal","openshift-multus/multus-additional-cni-plugins-k9kxr","openshift-multus/multus-bz7dl","openshift-multus/network-metrics-daemon-qzdgl","openshift-network-operator/iptables-alerter-phwv5","openshift-ovn-kubernetes/ovnkube-node-h2qzv","kube-system/global-pull-secret-syncer-mtknb","kube-system/konnectivity-agent-sstg2","kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal","openshift-cluster-node-tuning-operator/tuned-84nrm","openshift-dns/node-resolver-p562h","openshift-network-diagnostics/network-check-target-px9qb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj"] Jun 11 23:10:04.320003 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.319973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.322100 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.322080 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:04.322177 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.322156 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:04.324604 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.324584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.327213 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.327073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.327953 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.327891 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 23:10:04.328039 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.327974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.328482 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.328284 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 23:10:04.328482 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.328324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 23:10:04.328482 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.328380 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.329288 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.329270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.329379 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.329343 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:04.329725 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.329605 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q8psm\"" Jun 11 23:10:04.330183 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.330169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 23:10:04.330272 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.330211 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 23:10:04.330430 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.330411 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 23:10:04.330638 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.330600 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 23:10:04.330834 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.330817 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.331649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.331591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sbqpc\"" Jun 11 23:10:04.331737 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.331673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.331897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.331883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.332909 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.332889 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qmq5j\"" Jun 11 23:10:04.333028 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.333015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 23:10:04.336120 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.336100 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 23:10:04.336318 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.336299 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 23:10:04.336395 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.336347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.336533 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.336512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lhvll\"" Jun 11 23:10:04.336811 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.336789 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.338622 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.338600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.341097 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.341078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.343529 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.343509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.345804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.345789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.345895 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.345862 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:04.345956 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.345934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-systemd\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.345998 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.345965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-cni-binary-copy\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.345998 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.345985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-os-release\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-k8s-cni-cncf-io\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-kubelet\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-conf-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-ovn\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346238 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-os-release\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.346238 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-netns\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346238 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-cni-bin\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346238 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346179 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-slash\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346238 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a07f0805-1e63-4d40-ba24-bbe3f269349b-host-slash\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/067c87ce-cdba-493d-b6be-59a64827370f-agent-certs\") pod \"konnectivity-agent-sstg2\" (UID: \"067c87ce-cdba-493d-b6be-59a64827370f\") " pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346330 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlx8f\" (UniqueName: \"kubernetes.io/projected/17161d73-8451-4b27-8427-170033f90348-kube-api-access-zlx8f\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346371 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346382 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 23:10:04.346475 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-system-cni-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-log-socket\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346585 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-ovnkube-config\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-cnibin\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-socket-dir-parent\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346730 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-multus-certs\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a07f0805-1e63-4d40-ba24-bbe3f269349b-iptables-alerter-script\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-env-overrides\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346838 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zlfj9\"" Jun 11 23:10:04.346907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-system-cni-dir\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346926 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pf57m\"" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txf4n\" (UniqueName: \"kubernetes.io/projected/446c6a64-0dd1-4c08-a064-e6a93dba48de-kube-api-access-txf4n\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-run-netns\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.346988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-ovnkube-script-lib\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-cni-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1102fc10-c0a5-4f12-83fa-d70416c08ae1-cni-binary-copy\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-cni-netd\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347172 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/067c87ce-cdba-493d-b6be-59a64827370f-konnectivity-ca\") pod \"konnectivity-agent-sstg2\" (UID: \"067c87ce-cdba-493d-b6be-59a64827370f\") " pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-cni-bin\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85l2g\" (UniqueName: \"kubernetes.io/projected/65ff678b-f159-4d71-a6c0-8144faeec48f-kube-api-access-85l2g\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-cnibin\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-hostroot\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-etc-kubernetes\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.347546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347296 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2wqv\"" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvv82\" (UniqueName: \"kubernetes.io/projected/1102fc10-c0a5-4f12-83fa-d70416c08ae1-kube-api-access-rvv82\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggrxg\" (UniqueName: \"kubernetes.io/projected/a07f0805-1e63-4d40-ba24-bbe3f269349b-kube-api-access-ggrxg\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-var-lib-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-etc-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-node-log\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65ff678b-f159-4d71-a6c0-8144faeec48f-ovn-node-metrics-cert\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-cni-multus\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-daemon-config\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-systemd-units\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-kubelet\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.348302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.347776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.348851 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.348399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.350439 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.350419 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.351087 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.351068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.351413 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.351394 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tlt84\"" Jun 11 23:10:04.352687 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.352669 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.356433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.356416 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 23:10:04.356934 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.356917 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 23:10:04.357058 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.357041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cv6dl\"" Jun 11 23:10:04.365959 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.365936 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:10:04.403292 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.403273 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w2vzv" Jun 11 23:10:04.408578 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.408516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" event={"ID":"0f9f10ff7554a468a59d8d8df982b08b","Type":"ContainerStarted","Data":"84fb8e58a822046919e433e17ab0dbaf5f4887a36aaa1c48cc51fd19fe9f55b7"} Jun 11 23:10:04.412851 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.412820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" event={"ID":"92a9fbefb60d8cd75a07802386812876","Type":"ContainerStarted","Data":"d5a9014f9f88fe0cd9f8f15dd8a4851e85f7da945a4b2a839c6593a9820fe639"} Jun 11 23:10:04.414093 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.414075 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w2vzv" Jun 11 23:10:04.437362 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.437341 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 23:10:04.448186 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-systemd-units\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.448285 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-kubelet\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.448285 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-conf-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.448285 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/187e60e2-0625-4d01-a77e-3d4db6f87a91-hosts-file\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-registration-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a07f0805-1e63-4d40-ba24-bbe3f269349b-host-slash\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/067c87ce-cdba-493d-b6be-59a64827370f-agent-certs\") pod \"konnectivity-agent-sstg2\" (UID: \"067c87ce-cdba-493d-b6be-59a64827370f\") " pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlx8f\" (UniqueName: \"kubernetes.io/projected/17161d73-8451-4b27-8427-170033f90348-kube-api-access-zlx8f\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.448433 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-socket-dir-parent\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-sys\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-multus-certs\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c201ca53-89c9-4125-be2c-ab2e0b2569b3-host\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c201ca53-89c9-4125-be2c-ab2e0b2569b3-serviceca\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16a33568-12c5-418e-9824-4dd48eaa26c7-kubelet-config\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-env-overrides\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-tuned\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-socket-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-ovnkube-script-lib\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-cni-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16a33568-12c5-418e-9824-4dd48eaa26c7-dbus\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.448792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-cni-netd\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/067c87ce-cdba-493d-b6be-59a64827370f-konnectivity-ca\") pod \"konnectivity-agent-sstg2\" (UID: \"067c87ce-cdba-493d-b6be-59a64827370f\") " pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-cni-bin\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l2g\" (UniqueName: \"kubernetes.io/projected/65ff678b-f159-4d71-a6c0-8144faeec48f-kube-api-access-85l2g\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-cnibin\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-var-lib-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-etc-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.448972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysctl-d\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysctl-conf\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx855\" (UniqueName: \"kubernetes.io/projected/187e60e2-0625-4d01-a77e-3d4db6f87a91-kube-api-access-kx855\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-kubelet\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-systemd\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-cni-binary-copy\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-os-release\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-k8s-cni-cncf-io\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.449312 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-modprobe-d\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysconfig\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-tmp\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-ovn\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-os-release\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-netns\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-cni-bin\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-var-lib-kubelet\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2llrh\" (UniqueName: \"kubernetes.io/projected/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-kube-api-access-2llrh\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmkn8\" (UniqueName: \"kubernetes.io/projected/c201ca53-89c9-4125-be2c-ab2e0b2569b3-kube-api-access-cmkn8\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-device-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-slash\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-system-cni-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-kubernetes\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-log-socket\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-ovnkube-config\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-cnibin\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.449989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-systemd\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/187e60e2-0625-4d01-a77e-3d4db6f87a91-tmp-dir\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a07f0805-1e63-4d40-ba24-bbe3f269349b-iptables-alerter-script\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-system-cni-dir\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-run\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-host\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txf4n\" (UniqueName: \"kubernetes.io/projected/446c6a64-0dd1-4c08-a064-e6a93dba48de-kube-api-access-txf4n\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-run-netns\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1102fc10-c0a5-4f12-83fa-d70416c08ae1-cni-binary-copy\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-hostroot\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-etc-kubernetes\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvv82\" (UniqueName: \"kubernetes.io/projected/1102fc10-c0a5-4f12-83fa-d70416c08ae1-kube-api-access-rvv82\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-sys-fs\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.450668 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.449999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dqf6\" (UniqueName: \"kubernetes.io/projected/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-kube-api-access-2dqf6\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggrxg\" (UniqueName: \"kubernetes.io/projected/a07f0805-1e63-4d40-ba24-bbe3f269349b-kube-api-access-ggrxg\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-node-log\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65ff678b-f159-4d71-a6c0-8144faeec48f-ovn-node-metrics-cert\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-cni-multus\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-daemon-config\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-lib-modules\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450244 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-systemd-units\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-kubelet\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450316 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-conf-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a07f0805-1e63-4d40-ba24-bbe3f269349b-host-slash\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.450783 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451144 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-ovn\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-os-release\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.451307 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-netns\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451886 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-cni-bin\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451886 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-socket-dir-parent\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.451886 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451478 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-system-cni-dir\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.451886 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-run-netns\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.451886 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.452065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451902 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-etc-kubernetes\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.452065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a07f0805-1e63-4d40-ba24-bbe3f269349b-iptables-alerter-script\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.452065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.451976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-etc-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.452065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.452524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452503 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-cni-binary-copy\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.452652 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-os-release\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.452708 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452660 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-k8s-cni-cncf-io\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.452708 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-log-socket\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.452778 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-node-log\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.452778 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-slash\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.452843 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452787 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-system-cni-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.452843 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-cni-dir\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.452901 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.452860 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-var-lib-cni-multus\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.453275 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-cni-netd\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.453344 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453236 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-ovnkube-config\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.453387 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453352 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1102fc10-c0a5-4f12-83fa-d70416c08ae1-multus-daemon-config\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.453387 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-cnibin\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.453457 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453396 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-var-lib-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.453457 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-openvswitch\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.453525 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.453466 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:04.453575 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.453540 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:10:04.953506975 +0000 UTC m=+3.039433542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:04.453776 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453758 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-host-run-multus-certs\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.453776 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/067c87ce-cdba-493d-b6be-59a64827370f-konnectivity-ca\") pod \"konnectivity-agent-sstg2\" (UID: \"067c87ce-cdba-493d-b6be-59a64827370f\") " pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.453873 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453818 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1102fc10-c0a5-4f12-83fa-d70416c08ae1-hostroot\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.453873 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-kubelet\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.453873 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17161d73-8451-4b27-8427-170033f90348-cnibin\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.453873 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-env-overrides\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.454069 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.453923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-run-systemd\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.454305 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.454284 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65ff678b-f159-4d71-a6c0-8144faeec48f-ovnkube-script-lib\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.454368 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.454340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ff678b-f159-4d71-a6c0-8144faeec48f-host-cni-bin\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.454422 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.454371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.454577 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.454542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17161d73-8451-4b27-8427-170033f90348-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.454772 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.454750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/067c87ce-cdba-493d-b6be-59a64827370f-agent-certs\") pod \"konnectivity-agent-sstg2\" (UID: \"067c87ce-cdba-493d-b6be-59a64827370f\") " pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.454772 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.454766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1102fc10-c0a5-4f12-83fa-d70416c08ae1-cni-binary-copy\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.455029 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.455010 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65ff678b-f159-4d71-a6c0-8144faeec48f-ovn-node-metrics-cert\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.459660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.459639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggrxg\" (UniqueName: \"kubernetes.io/projected/a07f0805-1e63-4d40-ba24-bbe3f269349b-kube-api-access-ggrxg\") pod \"iptables-alerter-phwv5\" (UID: \"a07f0805-1e63-4d40-ba24-bbe3f269349b\") " pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.461222 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.461200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txf4n\" (UniqueName: \"kubernetes.io/projected/446c6a64-0dd1-4c08-a064-e6a93dba48de-kube-api-access-txf4n\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.461302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.461226 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlx8f\" (UniqueName: \"kubernetes.io/projected/17161d73-8451-4b27-8427-170033f90348-kube-api-access-zlx8f\") pod \"multus-additional-cni-plugins-k9kxr\" (UID: \"17161d73-8451-4b27-8427-170033f90348\") " pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.463937 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.463914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvv82\" (UniqueName: \"kubernetes.io/projected/1102fc10-c0a5-4f12-83fa-d70416c08ae1-kube-api-access-rvv82\") pod \"multus-bz7dl\" (UID: \"1102fc10-c0a5-4f12-83fa-d70416c08ae1\") " pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.464502 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.464485 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:04.464502 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.464503 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:04.464707 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.464513 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:04.464707 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.464533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85l2g\" (UniqueName: \"kubernetes.io/projected/65ff678b-f159-4d71-a6c0-8144faeec48f-kube-api-access-85l2g\") pod \"ovnkube-node-h2qzv\" (UID: \"65ff678b-f159-4d71-a6c0-8144faeec48f\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.464707 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.464631 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:04.964614497 +0000 UTC m=+3.050541061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:04.550862 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-systemd\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/187e60e2-0625-4d01-a77e-3d4db6f87a91-tmp-dir\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-run\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-host\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-systemd\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.550990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-sys-fs\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551031 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dqf6\" (UniqueName: \"kubernetes.io/projected/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-kube-api-access-2dqf6\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-lib-modules\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/187e60e2-0625-4d01-a77e-3d4db6f87a91-hosts-file\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-registration-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-sys\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c201ca53-89c9-4125-be2c-ab2e0b2569b3-host\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c201ca53-89c9-4125-be2c-ab2e0b2569b3-serviceca\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16a33568-12c5-418e-9824-4dd48eaa26c7-kubelet-config\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551235 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-sys-fs\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551248 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-tuned\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551296 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-run\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551377 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-socket-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16a33568-12c5-418e-9824-4dd48eaa26c7-dbus\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysctl-d\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-lib-modules\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysctl-conf\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx855\" (UniqueName: \"kubernetes.io/projected/187e60e2-0625-4d01-a77e-3d4db6f87a91-kube-api-access-kx855\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/187e60e2-0625-4d01-a77e-3d4db6f87a91-hosts-file\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-modprobe-d\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysconfig\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-tmp\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-var-lib-kubelet\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2llrh\" (UniqueName: \"kubernetes.io/projected/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-kube-api-access-2llrh\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmkn8\" (UniqueName: \"kubernetes.io/projected/c201ca53-89c9-4125-be2c-ab2e0b2569b3-kube-api-access-cmkn8\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-device-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-kubernetes\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.551897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/187e60e2-0625-4d01-a77e-3d4db6f87a91-tmp-dir\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16a33568-12c5-418e-9824-4dd48eaa26c7-dbus\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551884 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysctl-conf\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.551962 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-modprobe-d\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-var-lib-kubelet\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysconfig\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.552092 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:05.052071092 +0000 UTC m=+3.137997651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552101 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-host\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.551886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-kubernetes\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552264 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-sysctl-d\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552300 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-socket-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-device-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552351 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-sys\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c201ca53-89c9-4125-be2c-ab2e0b2569b3-host\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.552661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16a33568-12c5-418e-9824-4dd48eaa26c7-kubelet-config\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:04.553300 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-registration-dir\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.553300 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.552661 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c201ca53-89c9-4125-be2c-ab2e0b2569b3-serviceca\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.553860 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.553841 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-etc-tuned\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.554396 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.554375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-tmp\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.566070 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.565999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx855\" (UniqueName: \"kubernetes.io/projected/187e60e2-0625-4d01-a77e-3d4db6f87a91-kube-api-access-kx855\") pod \"node-resolver-p562h\" (UID: \"187e60e2-0625-4d01-a77e-3d4db6f87a91\") " pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.567467 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.567445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2llrh\" (UniqueName: \"kubernetes.io/projected/a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc-kube-api-access-2llrh\") pod \"tuned-84nrm\" (UID: \"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc\") " pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.567585 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.567540 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dqf6\" (UniqueName: \"kubernetes.io/projected/cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3-kube-api-access-2dqf6\") pod \"aws-ebs-csi-driver-node-jf5dj\" (UID: \"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.567793 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.567777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmkn8\" (UniqueName: \"kubernetes.io/projected/c201ca53-89c9-4125-be2c-ab2e0b2569b3-kube-api-access-cmkn8\") pod \"node-ca-cjgvx\" (UID: \"c201ca53-89c9-4125-be2c-ab2e0b2569b3\") " pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.631027 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.631000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:04.642376 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.642355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" Jun 11 23:10:04.648337 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.648316 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bz7dl" Jun 11 23:10:04.655477 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.655460 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-phwv5" Jun 11 23:10:04.664160 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.664142 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:04.670688 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.670670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cjgvx" Jun 11 23:10:04.677725 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.677701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" Jun 11 23:10:04.682110 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.682094 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:04.685832 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.685809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84nrm" Jun 11 23:10:04.690380 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.690366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p562h" Jun 11 23:10:04.954328 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:04.954243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:04.954477 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.954375 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:04.954477 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:04.954439 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:10:05.954419528 +0000 UTC m=+4.040346083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:05.054775 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.054741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:05.054951 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.054799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:05.054951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.054919 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:05.054951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.054923 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:05.054951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.054948 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:05.055126 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.054960 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:05.055126 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.054976 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:06.054960249 +0000 UTC m=+4.140886789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:05.055126 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.055012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:06.054995477 +0000 UTC m=+4.140922018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:05.390606 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.390525 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc201ca53_89c9_4125_be2c_ab2e0b2569b3.slice/crio-a035ce5b464babf8f4972a09b668dc6df137f3e5b0f8b94695ade33af06a42dc WatchSource:0}: Error finding container a035ce5b464babf8f4972a09b668dc6df137f3e5b0f8b94695ade33af06a42dc: Status 404 returned error can't find the container with id a035ce5b464babf8f4972a09b668dc6df137f3e5b0f8b94695ade33af06a42dc Jun 11 23:10:05.392208 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.392181 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ff678b_f159_4d71_a6c0_8144faeec48f.slice/crio-f31db1292b762acef5af63620013f79faf724165fea25b37680a5cc96b9c8cc9 WatchSource:0}: Error finding container f31db1292b762acef5af63620013f79faf724165fea25b37680a5cc96b9c8cc9: Status 404 returned error can't find the container with id f31db1292b762acef5af63620013f79faf724165fea25b37680a5cc96b9c8cc9 Jun 11 23:10:05.395930 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.395909 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067c87ce_cdba_493d_b6be_59a64827370f.slice/crio-7c674eaa6c292d852d163fec952fc582864e0eac93551295395723c696a56e29 WatchSource:0}: Error finding container 7c674eaa6c292d852d163fec952fc582864e0eac93551295395723c696a56e29: Status 404 returned error can't find the container with id 7c674eaa6c292d852d163fec952fc582864e0eac93551295395723c696a56e29 Jun 11 23:10:05.396754 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.396730 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187e60e2_0625_4d01_a77e_3d4db6f87a91.slice/crio-e820af6bbc385971e886d68e2ef56857097e9af26569bb24c1dcddfaf69a885d WatchSource:0}: Error finding container e820af6bbc385971e886d68e2ef56857097e9af26569bb24c1dcddfaf69a885d: Status 404 returned error can't find the container with id e820af6bbc385971e886d68e2ef56857097e9af26569bb24c1dcddfaf69a885d Jun 11 23:10:05.397609 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.397515 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e5c3aa_48ea_4f4d_812d_d39c4a83f2dc.slice/crio-a9aaf5abfb1e669389afcb3f2a660323b2c18e6994b372e168ff2015e68e67ac WatchSource:0}: Error finding container a9aaf5abfb1e669389afcb3f2a660323b2c18e6994b372e168ff2015e68e67ac: Status 404 returned error can't find the container with id a9aaf5abfb1e669389afcb3f2a660323b2c18e6994b372e168ff2015e68e67ac Jun 11 23:10:05.399266 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.399238 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1102fc10_c0a5_4f12_83fa_d70416c08ae1.slice/crio-959f690ec7f01dbddf273e432a5b6c2dcddfc1d4a5104cf9fff18f915184d283 WatchSource:0}: Error finding container 959f690ec7f01dbddf273e432a5b6c2dcddfc1d4a5104cf9fff18f915184d283: Status 404 returned error can't find the container with id 959f690ec7f01dbddf273e432a5b6c2dcddfc1d4a5104cf9fff18f915184d283 Jun 11 23:10:05.400574 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.400532 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6e6ef1_5388_4ab3_9fe8_c3a03bd52de3.slice/crio-add1d7a37a1b56f5372075fe53ee4bf6794bdc772a1dd5d44edda2422809ae15 WatchSource:0}: Error finding container add1d7a37a1b56f5372075fe53ee4bf6794bdc772a1dd5d44edda2422809ae15: Status 404 returned error can't find the container with id add1d7a37a1b56f5372075fe53ee4bf6794bdc772a1dd5d44edda2422809ae15 Jun 11 23:10:05.401449 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.400907 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07f0805_1e63_4d40_ba24_bbe3f269349b.slice/crio-9b2f658271d2bc21b1f4fc381fccd1b857d792dd3b6b99efb6b128be9e85252b WatchSource:0}: Error finding container 9b2f658271d2bc21b1f4fc381fccd1b857d792dd3b6b99efb6b128be9e85252b: Status 404 returned error can't find the container with id 9b2f658271d2bc21b1f4fc381fccd1b857d792dd3b6b99efb6b128be9e85252b Jun 11 23:10:05.404405 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:05.404029 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17161d73_8451_4b27_8427_170033f90348.slice/crio-7798e7745efe74957a4e8fbc33d553ed9cfb40b9a9c44384c8ca58a342fbb5b9 WatchSource:0}: Error finding container 7798e7745efe74957a4e8fbc33d553ed9cfb40b9a9c44384c8ca58a342fbb5b9: Status 404 returned error can't find the container with id 7798e7745efe74957a4e8fbc33d553ed9cfb40b9a9c44384c8ca58a342fbb5b9 Jun 11 23:10:05.415257 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.415230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p562h" event={"ID":"187e60e2-0625-4d01-a77e-3d4db6f87a91","Type":"ContainerStarted","Data":"e820af6bbc385971e886d68e2ef56857097e9af26569bb24c1dcddfaf69a885d"} Jun 11 23:10:05.416360 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.416334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"f31db1292b762acef5af63620013f79faf724165fea25b37680a5cc96b9c8cc9"} Jun 11 23:10:05.416999 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.416974 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:05:04 +0000 UTC" deadline="2028-03-07 21:48:15.852301152 +0000 UTC" Jun 11 23:10:05.416999 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.416999 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15238h38m10.435305439s" Jun 11 23:10:05.417534 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.417512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cjgvx" event={"ID":"c201ca53-89c9-4125-be2c-ab2e0b2569b3","Type":"ContainerStarted","Data":"a035ce5b464babf8f4972a09b668dc6df137f3e5b0f8b94695ade33af06a42dc"} Jun 11 23:10:05.418686 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.418491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerStarted","Data":"7798e7745efe74957a4e8fbc33d553ed9cfb40b9a9c44384c8ca58a342fbb5b9"} Jun 11 23:10:05.419476 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.419448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bz7dl" event={"ID":"1102fc10-c0a5-4f12-83fa-d70416c08ae1","Type":"ContainerStarted","Data":"959f690ec7f01dbddf273e432a5b6c2dcddfc1d4a5104cf9fff18f915184d283"} Jun 11 23:10:05.420612 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.420585 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" event={"ID":"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3","Type":"ContainerStarted","Data":"add1d7a37a1b56f5372075fe53ee4bf6794bdc772a1dd5d44edda2422809ae15"} Jun 11 23:10:05.421811 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.421784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84nrm" event={"ID":"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc","Type":"ContainerStarted","Data":"a9aaf5abfb1e669389afcb3f2a660323b2c18e6994b372e168ff2015e68e67ac"} Jun 11 23:10:05.422813 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.422780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sstg2" event={"ID":"067c87ce-cdba-493d-b6be-59a64827370f","Type":"ContainerStarted","Data":"7c674eaa6c292d852d163fec952fc582864e0eac93551295395723c696a56e29"} Jun 11 23:10:05.423819 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.423801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-phwv5" event={"ID":"a07f0805-1e63-4d40-ba24-bbe3f269349b","Type":"ContainerStarted","Data":"9b2f658271d2bc21b1f4fc381fccd1b857d792dd3b6b99efb6b128be9e85252b"} Jun 11 23:10:05.962804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:05.961933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:05.962804 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.962329 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:05.962804 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:05.962396 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:10:07.962377682 +0000 UTC m=+6.048304249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:06.063014 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.062975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:06.063190 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.063047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:06.063190 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.063173 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:06.063299 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.063235 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:08.063217032 +0000 UTC m=+6.149143591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:06.063680 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.063656 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:06.063680 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.063681 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:06.063832 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.063694 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:06.063832 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.063739 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:08.063724856 +0000 UTC m=+6.149651412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:06.405696 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.405666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:06.406143 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.405788 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:06.406212 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.406165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:06.406588 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.406266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:06.406588 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.406337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:06.406588 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:06.406399 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:06.417772 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.417721 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:05:04 +0000 UTC" deadline="2027-12-08 22:16:17.258121254 +0000 UTC" Jun 11 23:10:06.417772 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.417750 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13079h6m10.840375917s" Jun 11 23:10:06.431393 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.431365 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f9f10ff7554a468a59d8d8df982b08b" containerID="af44336915c34837dd4bd050fbb24f101cb8d54cebdb3c24542d5a71b36a2aeb" exitCode=0 Jun 11 23:10:06.431982 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.431956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" event={"ID":"0f9f10ff7554a468a59d8d8df982b08b","Type":"ContainerDied","Data":"af44336915c34837dd4bd050fbb24f101cb8d54cebdb3c24542d5a71b36a2aeb"} Jun 11 23:10:06.444611 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.444582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" event={"ID":"92a9fbefb60d8cd75a07802386812876","Type":"ContainerStarted","Data":"1b4caa44d9b7407ee000176912c214d784495416626ee56bb9eee9d1827ce392"} Jun 11 23:10:06.469838 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:06.469791 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-190.ec2.internal" podStartSLOduration=3.46977365 podStartE2EDuration="3.46977365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:06.468752895 +0000 UTC m=+4.554679460" watchObservedRunningTime="2026-06-11 23:10:06.46977365 +0000 UTC m=+4.555700235" Jun 11 23:10:07.463626 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:07.463591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" event={"ID":"0f9f10ff7554a468a59d8d8df982b08b","Type":"ContainerStarted","Data":"d70c082b8951d1c16c891b473ded98ea5f250d9a834939befced8ab67cbbd384"} Jun 11 23:10:07.483160 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:07.482328 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-190.ec2.internal" podStartSLOduration=4.482308519 podStartE2EDuration="4.482308519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:07.481641945 +0000 UTC m=+5.567568539" watchObservedRunningTime="2026-06-11 23:10:07.482308519 +0000 UTC m=+5.568235082" Jun 11 23:10:07.978416 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:07.978378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:07.978661 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:07.978555 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:07.978661 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:07.978644 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:10:11.978627071 +0000 UTC m=+10.064553624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:08.078792 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:08.078751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:08.078964 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:08.078823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:08.079020 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.078965 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:08.079064 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.079027 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:12.079008571 +0000 UTC m=+10.164935124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:08.079461 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.079439 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:08.079547 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.079465 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:08.079547 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.079479 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:08.079547 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.079522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:12.079507616 +0000 UTC m=+10.165434176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:08.404700 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:08.404673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:08.404878 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.404797 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:08.405200 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:08.405171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:08.405292 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.405266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:08.405425 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:08.405408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:08.405522 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:08.405503 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:10.406420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:10.406384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:10.407017 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:10.406525 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:10.407017 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:10.406604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:10.407017 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:10.406672 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:10.407017 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:10.406708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:10.407017 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:10.406776 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:12.015817 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:12.015769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:12.016354 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.015970 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:12.016354 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.016038 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:10:20.016019011 +0000 UTC m=+18.101945567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:12.116167 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:12.116127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:12.116327 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:12.116182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:12.116327 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.116324 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:12.116444 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.116323 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:12.116444 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.116342 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:12.116444 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.116357 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:12.116444 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.116401 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:20.116378832 +0000 UTC m=+18.202305392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:12.116444 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.116425 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:20.116413948 +0000 UTC m=+18.202340491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:12.411380 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:12.410938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:12.411380 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.411058 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:12.411380 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:12.411098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:12.411380 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.411222 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:12.411380 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:12.411276 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:12.411380 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:12.411332 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:14.406714 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:14.406680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:14.407294 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:14.406688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:14.407294 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:14.406821 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:14.407294 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:14.406982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:14.407736 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:14.407662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:14.407736 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:14.406932 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:16.404687 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:16.404650 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:16.405155 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:16.404650 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:16.405155 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:16.404770 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:16.405155 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:16.404799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:16.405155 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:16.404887 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:16.405155 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:16.404976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:18.407272 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:18.407243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:18.407733 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:18.407244 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:18.407733 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:18.407356 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:18.407733 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:18.407244 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:18.407733 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:18.407430 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:18.407733 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:18.407491 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:20.073637 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:20.073592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:20.074136 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.073742 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:20.074136 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.073813 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:10:36.073795877 +0000 UTC m=+34.159722416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:20.174786 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:20.174748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:20.174951 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:20.174804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:20.174951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.174896 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:20.174951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.174912 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:20.174951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.174929 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:20.174951 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.174941 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:20.175118 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.174966 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:36.174946898 +0000 UTC m=+34.260873458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:20.175118 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.174982 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:36.174971881 +0000 UTC m=+34.260898447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:20.404507 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:20.404469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:20.404662 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:20.404469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:20.404662 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.404601 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:20.404662 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:20.404619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:20.404781 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.404716 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:20.404815 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:20.404793 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:22.405582 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:22.405537 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:22.405984 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:22.405636 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:22.405984 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:22.405651 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:22.405984 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:22.405741 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:22.405984 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:22.405757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:22.405984 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:22.405874 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:24.404844 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.404816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:24.405439 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:24.404934 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:24.405439 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.404954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:24.405439 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:24.405063 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:24.405439 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.405092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:24.405439 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:24.405162 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:24.500056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.499839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p562h" event={"ID":"187e60e2-0625-4d01-a77e-3d4db6f87a91","Type":"ContainerStarted","Data":"e24f12ced0f965a116666a38be35e0105edd98ad174bf96f98ca5b138f794d41"} Jun 11 23:10:24.501541 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.501516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerStarted","Data":"8d42c866fdfbc63c714734ee4677c2d70e2c21a91cb06ed9374ff6cb46f51cff"} Jun 11 23:10:24.504586 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.503843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" event={"ID":"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3","Type":"ContainerStarted","Data":"63ee2dfc1077ed67325d0843533a2d5be7ad56a14289b7de3ecedf0fe3b0a8e8"} Jun 11 23:10:24.507298 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.507235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sstg2" event={"ID":"067c87ce-cdba-493d-b6be-59a64827370f","Type":"ContainerStarted","Data":"1fdabae6ed5344e3e415a33e218fb85a63134ad17e061e35d899008d82d8d3fd"} Jun 11 23:10:24.515918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.515868 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p562h" podStartSLOduration=3.729849265 podStartE2EDuration="22.51585234s" totalImagesPullingTime="18.786003075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:24.515399128 +0000 UTC m=+22.601325694" watchObservedRunningTime="2026-06-11 23:10:24.51585234 +0000 UTC m=+22.601778903" Jun 11 23:10:24.552103 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:24.552055 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sstg2" podStartSLOduration=3.765090242 podStartE2EDuration="22.552038705s" totalImagesPullingTime="18.786948463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:24.551499544 +0000 UTC m=+22.637426145" watchObservedRunningTime="2026-06-11 23:10:24.552038705 +0000 UTC m=+22.637965266" Jun 11 23:10:25.511550 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.511052 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84nrm" event={"ID":"a4e5c3aa-48ea-4f4d-812d-d39c4a83f2dc","Type":"ContainerStarted","Data":"028d563bf4dbb7dd69e04547818aca8e43ffc5c459bdd85a4c7a3919ce75499c"} Jun 11 23:10:25.515530 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.515481 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:10:25.515858 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.515836 2581 generic.go:356] "Generic (PLEG): container finished" podID="65ff678b-f159-4d71-a6c0-8144faeec48f" containerID="99dd454f4ac7678062d66025cac72846fb3fc0ec4f18dfa8fabbffaa4f2a3627" exitCode=1 Jun 11 23:10:25.515961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.515904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"8f93425e8b26d41863b3fa9c15bb0f7f0a6c64338c59472b58a0570a62edf00d"} Jun 11 23:10:25.516018 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.515989 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"fea537ab4b1ae6e5897d45e56f6ade57f8c759b273d687959dd9c4b4258981e1"} Jun 11 23:10:25.516077 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.516041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"70e655612400e7c31a1ee67e69dc5e8768ab5f4a1ef2cd417f30b89e2a5e1bf0"} Jun 11 23:10:25.516132 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.516091 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"7bcd9d4d8b9c3c54fc03245ea62dba717de6e68817cfd86840aec82d2aee99ea"} Jun 11 23:10:25.516185 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.516140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerDied","Data":"99dd454f4ac7678062d66025cac72846fb3fc0ec4f18dfa8fabbffaa4f2a3627"} Jun 11 23:10:25.516239 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.516192 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"05d44bab172682c1f03a39112621d2536299e7e0f919f207d8183972b57b4acb"} Jun 11 23:10:25.517446 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.517419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cjgvx" event={"ID":"c201ca53-89c9-4125-be2c-ab2e0b2569b3","Type":"ContainerStarted","Data":"6b4fdf1f35a9d9619d73a0778f979169f2b940676737c5eaf3e16c2566affa87"} Jun 11 23:10:25.519419 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.519395 2581 generic.go:356] "Generic (PLEG): container finished" podID="17161d73-8451-4b27-8427-170033f90348" containerID="8d42c866fdfbc63c714734ee4677c2d70e2c21a91cb06ed9374ff6cb46f51cff" exitCode=0 Jun 11 23:10:25.519535 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.519483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerDied","Data":"8d42c866fdfbc63c714734ee4677c2d70e2c21a91cb06ed9374ff6cb46f51cff"} Jun 11 23:10:25.520953 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.520896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bz7dl" event={"ID":"1102fc10-c0a5-4f12-83fa-d70416c08ae1","Type":"ContainerStarted","Data":"82ca9565c3cf06dd13c771b0fec4dcca2e661f41935f4813e799cfd194987ebc"} Jun 11 23:10:25.530899 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.530864 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-84nrm" podStartSLOduration=4.699260742 podStartE2EDuration="23.530854006s" totalImagesPullingTime="18.831593264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:25.530810252 +0000 UTC m=+23.616736831" watchObservedRunningTime="2026-06-11 23:10:25.530854006 +0000 UTC m=+23.616780564" Jun 11 23:10:25.580199 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.580156 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bz7dl" podStartSLOduration=4.46717639 podStartE2EDuration="23.580142104s" totalImagesPullingTime="19.112965714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:25.579992106 +0000 UTC m=+23.665918679" watchObservedRunningTime="2026-06-11 23:10:25.580142104 +0000 UTC m=+23.666068666" Jun 11 23:10:25.601786 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.601749 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cjgvx" podStartSLOduration=4.780040859 podStartE2EDuration="23.601735795s" totalImagesPullingTime="18.821694936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:25.601026157 +0000 UTC m=+23.686952719" watchObservedRunningTime="2026-06-11 23:10:25.601735795 +0000 UTC m=+23.687662357" Jun 11 23:10:25.607382 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:25.607364 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 23:10:26.404771 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.404740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:26.405005 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:26.404877 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:26.405296 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.405272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:26.405426 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:26.405382 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:26.405547 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.405531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:26.405680 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:26.405658 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:26.407680 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.407555 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:10:25.607378854Z","UUID":"69a4e802-d6cd-4cf5-a1a2-4110bb1866d6","Handler":null,"Name":"","Endpoint":""} Jun 11 23:10:26.411526 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.409920 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 23:10:26.411526 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.409961 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 23:10:26.524419 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.524382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-phwv5" event={"ID":"a07f0805-1e63-4d40-ba24-bbe3f269349b","Type":"ContainerStarted","Data":"e21e43192a858a7ce1b137e70cc3b095ec1f73a5bdd8cfb8f12c8fe944a48b2b"} Jun 11 23:10:26.527132 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:26.527100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" event={"ID":"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3","Type":"ContainerStarted","Data":"9b6f38622e63dba73d43c7cab95e96dd5c7d171feef613659d0916335420c9b5"} Jun 11 23:10:27.532595 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:27.532499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" event={"ID":"cc6e6ef1-5388-4ab3-9fe8-c3a03bd52de3","Type":"ContainerStarted","Data":"b8d872dca0afdc9328a7ddeb79ed6365f64026338c31aa1980a18101720ef3b8"} Jun 11 23:10:27.536006 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:27.535984 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:10:27.536441 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:27.536414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"17b24dc6435c4611038dc20cf69fe26bc681e7badae350c52316cfce5e58a25a"} Jun 11 23:10:27.558724 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:27.558680 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf5dj" podStartSLOduration=4.685647252 podStartE2EDuration="25.558665891s" totalImagesPullingTime="20.873018639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:27.558408147 +0000 UTC m=+25.644334713" watchObservedRunningTime="2026-06-11 23:10:27.558665891 +0000 UTC m=+25.644592453" Jun 11 23:10:27.558989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:27.558969 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-phwv5" podStartSLOduration=6.72768984 podStartE2EDuration="25.558964242s" totalImagesPullingTime="18.831274402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:26.547607644 +0000 UTC m=+24.633534226" watchObservedRunningTime="2026-06-11 23:10:27.558964242 +0000 UTC m=+25.644890804" Jun 11 23:10:28.404778 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:28.404751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:28.404943 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:28.404813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:28.404943 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:28.404810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:28.404943 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:28.404910 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:28.405047 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:28.404994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:28.405047 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:28.405036 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:29.296463 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.296438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:29.297364 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.297345 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:29.545776 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.545678 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:10:29.546127 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.546092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"c6b8633efb9cd4ef866ffdb1c64976866e82ed5249bb1e23e4922109414b510f"} Jun 11 23:10:29.546421 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.546398 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:29.546692 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.546675 2581 scope.go:117] "RemoveContainer" containerID="99dd454f4ac7678062d66025cac72846fb3fc0ec4f18dfa8fabbffaa4f2a3627" Jun 11 23:10:29.546817 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:29.546802 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sstg2" Jun 11 23:10:30.404548 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:30.404515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:30.405010 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:30.404515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:30.405010 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:30.404647 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:30.405010 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:30.404515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:30.405010 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:30.404717 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:30.405010 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:30.404785 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:31.443576 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.443395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-px9qb"] Jun 11 23:10:31.443942 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.443662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:31.443942 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:31.443747 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:31.458543 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.458514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qzdgl"] Jun 11 23:10:31.458702 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.458644 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:31.458790 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:31.458767 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:31.459084 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.459065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtknb"] Jun 11 23:10:31.459146 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.459137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:31.459220 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:31.459205 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:31.555301 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.555251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:10:31.555654 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.555624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" event={"ID":"65ff678b-f159-4d71-a6c0-8144faeec48f","Type":"ContainerStarted","Data":"ca385c3fe06fd9a75839de66989c75a267b6413d120013ea599305d303afea54"} Jun 11 23:10:31.556054 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.555865 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:31.556054 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.555956 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:31.556054 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.556003 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:31.558230 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.558205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerStarted","Data":"4a8247308b8571ca59d1fe1539a312c1772b40547f9209c873c4ef202794bf50"} Jun 11 23:10:31.573186 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.573161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:31.573304 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.573258 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:10:31.610703 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:31.610612 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" podStartSLOduration=10.74354566 podStartE2EDuration="29.610596067s" totalImagesPullingTime="18.867050407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:31.607615368 +0000 UTC m=+29.693541948" watchObservedRunningTime="2026-06-11 23:10:31.610596067 +0000 UTC m=+29.696522631" Jun 11 23:10:32.562466 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:32.562430 2581 generic.go:356] "Generic (PLEG): container finished" podID="17161d73-8451-4b27-8427-170033f90348" containerID="4a8247308b8571ca59d1fe1539a312c1772b40547f9209c873c4ef202794bf50" exitCode=0 Jun 11 23:10:32.562931 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:32.562512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerDied","Data":"4a8247308b8571ca59d1fe1539a312c1772b40547f9209c873c4ef202794bf50"} Jun 11 23:10:33.404876 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:33.404843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:33.404876 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:33.404864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:33.405028 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:33.404852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:33.405028 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:33.404977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:33.405132 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:33.405106 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:33.405208 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:33.405189 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:34.568262 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:34.568227 2581 generic.go:356] "Generic (PLEG): container finished" podID="17161d73-8451-4b27-8427-170033f90348" containerID="46d520ea9b052777c6c32a64aa06e151d09bc1dcd4df14b6c92e81c43b79865e" exitCode=0 Jun 11 23:10:34.568856 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:34.568284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerDied","Data":"46d520ea9b052777c6c32a64aa06e151d09bc1dcd4df14b6c92e81c43b79865e"} Jun 11 23:10:35.404348 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:35.404178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:35.404617 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:35.404184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:35.404617 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:35.404421 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px9qb" podUID="2d421816-8f40-44a6-ba2c-6d06e0721597" Jun 11 23:10:35.404617 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:35.404184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:35.404617 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:35.404498 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtknb" podUID="16a33568-12c5-418e-9824-4dd48eaa26c7" Jun 11 23:10:35.404773 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:35.404626 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzdgl" podUID="446c6a64-0dd1-4c08-a064-e6a93dba48de" Jun 11 23:10:35.572636 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:35.572602 2581 generic.go:356] "Generic (PLEG): container finished" podID="17161d73-8451-4b27-8427-170033f90348" containerID="5c66dc63b0f411ebcb7d8083cc940228831e9f2021a8a61348c5d1559585dcd3" exitCode=0 Jun 11 23:10:35.572636 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:35.572637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerDied","Data":"5c66dc63b0f411ebcb7d8083cc940228831e9f2021a8a61348c5d1559585dcd3"} Jun 11 23:10:36.092923 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:36.092888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:36.093092 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.093030 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:36.093154 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.093096 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs podName:446c6a64-0dd1-4c08-a064-e6a93dba48de nodeName:}" failed. No retries permitted until 2026-06-11 23:11:08.0930786 +0000 UTC m=+66.179005139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs") pod "network-metrics-daemon-qzdgl" (UID: "446c6a64-0dd1-4c08-a064-e6a93dba48de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:36.193870 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:36.193838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:36.194056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:36.193899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:36.194056 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.194012 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:36.194056 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.194040 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:36.194056 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.194055 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:36.194233 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.194096 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret podName:16a33568-12c5-418e-9824-4dd48eaa26c7 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:08.19407809 +0000 UTC m=+66.280004641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret") pod "global-pull-secret-syncer-mtknb" (UID: "16a33568-12c5-418e-9824-4dd48eaa26c7") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:36.194233 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.194069 2581 projected.go:196] Error preparing data for projected volume kube-api-access-5xw7l for pod openshift-network-diagnostics/network-check-target-px9qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:36.194233 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:36.194139 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l podName:2d421816-8f40-44a6-ba2c-6d06e0721597 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:08.194127575 +0000 UTC m=+66.280054129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xw7l" (UniqueName: "kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l") pod "network-check-target-px9qb" (UID: "2d421816-8f40-44a6-ba2c-6d06e0721597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:37.180509 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.180441 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-190.ec2.internal" event="NodeReady" Jun 11 23:10:37.180871 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.180574 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 23:10:37.235271 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.235243 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b58c89b9-vqpg4"] Jun 11 23:10:37.251702 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.251674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.256382 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.256353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h97qp\"" Jun 11 23:10:37.256952 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.256622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 23:10:37.256952 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.256637 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vjxht"] Jun 11 23:10:37.256952 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.256826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 23:10:37.256952 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.256886 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 23:10:37.263948 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.263930 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 23:10:37.273263 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.273238 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m4k4n"] Jun 11 23:10:37.273395 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.273369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.276587 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.276545 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 23:10:37.276715 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.276596 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 23:10:37.276715 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.276648 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zbcp8\"" Jun 11 23:10:37.279447 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.279407 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 23:10:37.299233 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.299210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b58c89b9-vqpg4"] Jun 11 23:10:37.299233 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.299248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vjxht"] Jun 11 23:10:37.299432 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.299270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m4k4n"] Jun 11 23:10:37.299432 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.299333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.302276 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.302257 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 23:10:37.302387 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.302263 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 23:10:37.302387 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.302322 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjk8r\"" Jun 11 23:10:37.399867 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.399831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-ca-trust-extracted\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.399867 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.399877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-image-registry-private-configuration\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400085 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.399911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-tmp-dir\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.400085 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.399971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfvr\" (UniqueName: \"kubernetes.io/projected/480703bb-f7a8-4b45-807d-bf057019ec39-kube-api-access-txfvr\") pod \"ingress-canary-vjxht\" (UID: \"480703bb-f7a8-4b45-807d-bf057019ec39\") " pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.400085 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/480703bb-f7a8-4b45-807d-bf057019ec39-cert\") pod \"ingress-canary-vjxht\" (UID: \"480703bb-f7a8-4b45-807d-bf057019ec39\") " pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.400085 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-config-volume\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.400235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hhbr\" (UniqueName: \"kubernetes.io/projected/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-kube-api-access-9hhbr\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.400235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-installation-pull-secrets\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-certificates\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-trusted-ca\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400374 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400233 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400374 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-bound-sa-token\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400374 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fldl\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-kube-api-access-4fldl\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.400374 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.400315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.404908 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.404877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:10:37.404908 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.404892 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:10:37.405086 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.404878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:10:37.413227 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.413202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8q79j\"" Jun 11 23:10:37.413759 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.413595 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5cps\"" Jun 11 23:10:37.413759 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.413686 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:10:37.413880 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.413797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:10:37.413931 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.413878 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:10:37.413931 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.413797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:10:37.501483 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-ca-trust-extracted\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.501483 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-image-registry-private-configuration\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.501483 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-tmp-dir\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.501744 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfvr\" (UniqueName: \"kubernetes.io/projected/480703bb-f7a8-4b45-807d-bf057019ec39-kube-api-access-txfvr\") pod \"ingress-canary-vjxht\" (UID: \"480703bb-f7a8-4b45-807d-bf057019ec39\") " pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.501744 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/480703bb-f7a8-4b45-807d-bf057019ec39-cert\") pod \"ingress-canary-vjxht\" (UID: \"480703bb-f7a8-4b45-807d-bf057019ec39\") " pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.501826 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-config-volume\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.501826 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hhbr\" (UniqueName: \"kubernetes.io/projected/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-kube-api-access-9hhbr\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.501826 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-installation-pull-secrets\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.501826 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-tmp-dir\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.501961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-certificates\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.501961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-trusted-ca\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.501961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-ca-trust-extracted\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.501961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.502097 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-bound-sa-token\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.502097 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.501993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fldl\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-kube-api-access-4fldl\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.502097 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.502019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.502198 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:37.502127 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:37.502198 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:37.502182 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls podName:bdba22a5-6e6a-49f8-9051-2cd01ec03ff9 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:38.002165657 +0000 UTC m=+36.088092201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls") pod "dns-default-m4k4n" (UID: "bdba22a5-6e6a-49f8-9051-2cd01ec03ff9") : secret "dns-default-metrics-tls" not found Jun 11 23:10:37.503005 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:37.502788 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:10:37.503005 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:37.502808 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b58c89b9-vqpg4: secret "image-registry-tls" not found Jun 11 23:10:37.503005 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.502823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-config-volume\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.503005 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:37.502865 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls podName:f1f7b4e8-e910-46f8-9a3b-862f8e1200b4 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:38.002841262 +0000 UTC m=+36.088767831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls") pod "image-registry-68b58c89b9-vqpg4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4") : secret "image-registry-tls" not found Jun 11 23:10:37.504145 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.504019 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-trusted-ca\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.504605 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.504548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-certificates\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.506944 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.506924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-installation-pull-secrets\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.507045 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.506948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-image-registry-private-configuration\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.507448 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.507422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/480703bb-f7a8-4b45-807d-bf057019ec39-cert\") pod \"ingress-canary-vjxht\" (UID: \"480703bb-f7a8-4b45-807d-bf057019ec39\") " pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.517091 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.517067 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfvr\" (UniqueName: \"kubernetes.io/projected/480703bb-f7a8-4b45-807d-bf057019ec39-kube-api-access-txfvr\") pod \"ingress-canary-vjxht\" (UID: \"480703bb-f7a8-4b45-807d-bf057019ec39\") " pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.517990 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.517966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hhbr\" (UniqueName: \"kubernetes.io/projected/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-kube-api-access-9hhbr\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:37.518100 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.518004 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-bound-sa-token\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.519444 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.519425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fldl\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-kube-api-access-4fldl\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:37.582623 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.582591 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vjxht" Jun 11 23:10:37.832351 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:37.832314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vjxht"] Jun 11 23:10:37.836762 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:37.836736 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480703bb_f7a8_4b45_807d_bf057019ec39.slice/crio-81fb26341c7d46f369188628a21b512602ce0a73f864aa1f18751f2bdeebec4f WatchSource:0}: Error finding container 81fb26341c7d46f369188628a21b512602ce0a73f864aa1f18751f2bdeebec4f: Status 404 returned error can't find the container with id 81fb26341c7d46f369188628a21b512602ce0a73f864aa1f18751f2bdeebec4f Jun 11 23:10:38.005723 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.005637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:38.005723 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.005699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:38.005942 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:38.005799 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:10:38.005942 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:38.005823 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b58c89b9-vqpg4: secret "image-registry-tls" not found Jun 11 23:10:38.005942 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:38.005876 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:38.005942 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:38.005907 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls podName:f1f7b4e8-e910-46f8-9a3b-862f8e1200b4 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:39.005887981 +0000 UTC m=+37.091814542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls") pod "image-registry-68b58c89b9-vqpg4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4") : secret "image-registry-tls" not found Jun 11 23:10:38.006144 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:38.005949 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls podName:bdba22a5-6e6a-49f8-9051-2cd01ec03ff9 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:39.005937426 +0000 UTC m=+37.091863966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls") pod "dns-default-m4k4n" (UID: "bdba22a5-6e6a-49f8-9051-2cd01ec03ff9") : secret "dns-default-metrics-tls" not found Jun 11 23:10:38.581762 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.581725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vjxht" event={"ID":"480703bb-f7a8-4b45-807d-bf057019ec39","Type":"ContainerStarted","Data":"81fb26341c7d46f369188628a21b512602ce0a73f864aa1f18751f2bdeebec4f"} Jun 11 23:10:38.809435 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.809404 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wn5bv"] Jun 11 23:10:38.812242 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.812210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:38.821020 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.820996 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 23:10:38.821143 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.821004 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 23:10:38.823154 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.823129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 23:10:38.823337 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.823319 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 23:10:38.823820 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.823799 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljmsx\"" Jun 11 23:10:38.847175 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.847078 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wn5bv"] Jun 11 23:10:38.856843 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.856811 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288"] Jun 11 23:10:38.859699 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.859672 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" Jun 11 23:10:38.862735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.862705 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 23:10:38.862861 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.862776 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v7h6d\"" Jun 11 23:10:38.863168 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.863148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 23:10:38.874912 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.874883 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288"] Jun 11 23:10:38.913901 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.913790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:38.913901 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.913858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:38.914139 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.913958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-crio-socket\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:38.914139 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.913991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-data-volume\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:38.914139 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:38.914018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gshnp\" (UniqueName: \"kubernetes.io/projected/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-api-access-gshnp\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014543 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ps6f\" (UniqueName: \"kubernetes.io/projected/7066b57b-97ee-497e-bcd5-c308ac9e05e8-kube-api-access-2ps6f\") pod \"migrator-d4bcd4867-x7288\" (UID: \"7066b57b-97ee-497e-bcd5-c308ac9e05e8\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" Jun 11 23:10:39.014737 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-crio-socket\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014737 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-data-volume\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014737 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gshnp\" (UniqueName: \"kubernetes.io/projected/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-api-access-gshnp\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:39.014911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014767 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-crio-socket\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:39.014911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.014879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.014911 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.014888 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.014957 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:39.514938134 +0000 UTC m=+37.600864690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : secret "insights-runtime-extractor-tls" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.014956 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.014999 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.015002 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:39.514992103 +0000 UTC m=+37.600918661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : configmap "kube-rbac-proxy" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.015040 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls podName:bdba22a5-6e6a-49f8-9051-2cd01ec03ff9 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:41.015028604 +0000 UTC m=+39.100955144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls") pod "dns-default-m4k4n" (UID: "bdba22a5-6e6a-49f8-9051-2cd01ec03ff9") : secret "dns-default-metrics-tls" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.015093 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.015105 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b58c89b9-vqpg4: secret "image-registry-tls" not found Jun 11 23:10:39.015178 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.015133 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls podName:f1f7b4e8-e910-46f8-9a3b-862f8e1200b4 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:41.015126348 +0000 UTC m=+39.101052888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls") pod "image-registry-68b58c89b9-vqpg4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4") : secret "image-registry-tls" not found Jun 11 23:10:39.015509 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.015308 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-data-volume\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.027272 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.027247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gshnp\" (UniqueName: \"kubernetes.io/projected/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-api-access-gshnp\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.115536 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.115501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ps6f\" (UniqueName: \"kubernetes.io/projected/7066b57b-97ee-497e-bcd5-c308ac9e05e8-kube-api-access-2ps6f\") pod \"migrator-d4bcd4867-x7288\" (UID: \"7066b57b-97ee-497e-bcd5-c308ac9e05e8\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" Jun 11 23:10:39.125048 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.125024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ps6f\" (UniqueName: \"kubernetes.io/projected/7066b57b-97ee-497e-bcd5-c308ac9e05e8-kube-api-access-2ps6f\") pod \"migrator-d4bcd4867-x7288\" (UID: \"7066b57b-97ee-497e-bcd5-c308ac9e05e8\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" Jun 11 23:10:39.169998 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.169964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" Jun 11 23:10:39.519387 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.519298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.519387 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:39.519360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:39.519626 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.519441 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:10:39.519626 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.519542 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:40.519520144 +0000 UTC m=+38.605446689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : secret "insights-runtime-extractor-tls" not found Jun 11 23:10:39.519626 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.519446 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:10:39.519772 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:39.519674 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:40.519655611 +0000 UTC m=+38.605582150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : configmap "kube-rbac-proxy" not found Jun 11 23:10:40.442928 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.442739 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p562h_187e60e2-0625-4d01-a77e-3d4db6f87a91/dns-node-resolver/0.log" Jun 11 23:10:40.528728 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.528688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:40.528894 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.528753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:40.528894 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:40.528839 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:10:40.528894 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:40.528841 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:10:40.529004 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:40.528908 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:42.52889106 +0000 UTC m=+40.614817600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : configmap "kube-rbac-proxy" not found Jun 11 23:10:40.529004 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:40.528924 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:42.528915949 +0000 UTC m=+40.614842489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : secret "insights-runtime-extractor-tls" not found Jun 11 23:10:40.806506 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.805688 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-xfsrt"] Jun 11 23:10:40.830642 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.830612 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-xfsrt"] Jun 11 23:10:40.830757 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.830747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:40.833609 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.833576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 23:10:40.833731 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.833676 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 23:10:40.835274 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.834104 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gtchh\"" Jun 11 23:10:40.835274 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.834320 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 23:10:40.835274 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.834506 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 23:10:40.903137 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.903116 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288"] Jun 11 23:10:40.906369 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:40.906340 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7066b57b_97ee_497e_bcd5_c308ac9e05e8.slice/crio-afe634933087d1f513f89298b91640aa6868108d238adecbeb510aaca4feddb3 WatchSource:0}: Error finding container afe634933087d1f513f89298b91640aa6868108d238adecbeb510aaca4feddb3: Status 404 returned error can't find the container with id afe634933087d1f513f89298b91640aa6868108d238adecbeb510aaca4feddb3 Jun 11 23:10:40.932213 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.932168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-signing-cabundle\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:40.932392 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.932226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk2ql\" (UniqueName: \"kubernetes.io/projected/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-kube-api-access-dk2ql\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:40.932392 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:40.932357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-signing-key\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.032951 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.032863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:41.032951 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.032916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:41.033161 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.032959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-signing-key\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.033161 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:41.033024 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:10:41.033161 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:41.033042 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b58c89b9-vqpg4: secret "image-registry-tls" not found Jun 11 23:10:41.033161 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:41.033102 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls podName:f1f7b4e8-e910-46f8-9a3b-862f8e1200b4 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:45.033082646 +0000 UTC m=+43.119009186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls") pod "image-registry-68b58c89b9-vqpg4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4") : secret "image-registry-tls" not found Jun 11 23:10:41.033161 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:41.033103 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:41.033161 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.033130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-signing-cabundle\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.033463 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:41.033170 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls podName:bdba22a5-6e6a-49f8-9051-2cd01ec03ff9 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:45.033152622 +0000 UTC m=+43.119079166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls") pod "dns-default-m4k4n" (UID: "bdba22a5-6e6a-49f8-9051-2cd01ec03ff9") : secret "dns-default-metrics-tls" not found Jun 11 23:10:41.033463 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.033196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk2ql\" (UniqueName: \"kubernetes.io/projected/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-kube-api-access-dk2ql\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.033910 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.033886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-signing-cabundle\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.035978 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.035956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-signing-key\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.041763 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.041739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk2ql\" (UniqueName: \"kubernetes.io/projected/3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a-kube-api-access-dk2ql\") pod \"service-ca-7b994bc59-xfsrt\" (UID: \"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a\") " pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.151720 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.151526 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" Jun 11 23:10:41.241758 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.241730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cjgvx_c201ca53-89c9-4125-be2c-ab2e0b2569b3/node-ca/0.log" Jun 11 23:10:41.274728 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.274696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-xfsrt"] Jun 11 23:10:41.277857 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:41.277831 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccd2f6b_fd2b_4b88_83ac_ad8ee049b63a.slice/crio-bb1ad807d641e71397cf8bb80ee6d1cf868102aab24535372d2edc6c7f199d1e WatchSource:0}: Error finding container bb1ad807d641e71397cf8bb80ee6d1cf868102aab24535372d2edc6c7f199d1e: Status 404 returned error can't find the container with id bb1ad807d641e71397cf8bb80ee6d1cf868102aab24535372d2edc6c7f199d1e Jun 11 23:10:41.590621 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.590590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" event={"ID":"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a","Type":"ContainerStarted","Data":"bb1ad807d641e71397cf8bb80ee6d1cf868102aab24535372d2edc6c7f199d1e"} Jun 11 23:10:41.592269 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.592235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vjxht" event={"ID":"480703bb-f7a8-4b45-807d-bf057019ec39","Type":"ContainerStarted","Data":"098d7dc1a8486af871a5418d5c73d65f8c928ab2bd78c56dafc9797a9bd50be7"} Jun 11 23:10:41.593539 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.593519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" event={"ID":"7066b57b-97ee-497e-bcd5-c308ac9e05e8","Type":"ContainerStarted","Data":"afe634933087d1f513f89298b91640aa6868108d238adecbeb510aaca4feddb3"} Jun 11 23:10:41.596604 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.596581 2581 generic.go:356] "Generic (PLEG): container finished" podID="17161d73-8451-4b27-8427-170033f90348" containerID="71bb75ca915de00b7dcaa2e388d3ed953bf393326b1e564b07a8c1d9180b7c15" exitCode=0 Jun 11 23:10:41.596719 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.596620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerDied","Data":"71bb75ca915de00b7dcaa2e388d3ed953bf393326b1e564b07a8c1d9180b7c15"} Jun 11 23:10:41.611238 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:41.611191 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vjxht" podStartSLOduration=1.6766055739999999 podStartE2EDuration="4.611173793s" totalImagesPullingTime="2.934568219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:41.610254467 +0000 UTC m=+39.696181025" watchObservedRunningTime="2026-06-11 23:10:41.611173793 +0000 UTC m=+39.697100371" Jun 11 23:10:42.247192 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.247162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjxht_480703bb-f7a8-4b45-807d-bf057019ec39/serve-healthcheck-canary/0.log" Jun 11 23:10:42.544786 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.544712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:42.544915 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.544817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:42.544915 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:42.544847 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:10:42.544915 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:42.544914 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:46.544896742 +0000 UTC m=+44.630823305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : configmap "kube-rbac-proxy" not found Jun 11 23:10:42.545045 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:42.544921 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:10:42.545045 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:42.544956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:46.544945695 +0000 UTC m=+44.630872234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : secret "insights-runtime-extractor-tls" not found Jun 11 23:10:42.601730 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.601688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" event={"ID":"7066b57b-97ee-497e-bcd5-c308ac9e05e8","Type":"ContainerStarted","Data":"f5b06a444a4f25221390e21a87f2d1d9e35e14edd81a6738029da5ff53f3bb5c"} Jun 11 23:10:42.602173 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.601762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" event={"ID":"7066b57b-97ee-497e-bcd5-c308ac9e05e8","Type":"ContainerStarted","Data":"ebabded1a41d39c2509667f0c9cb61e7bb286900074cbab55bc78ac9c9c072a8"} Jun 11 23:10:42.605302 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.605272 2581 generic.go:356] "Generic (PLEG): container finished" podID="17161d73-8451-4b27-8427-170033f90348" containerID="b08e185267bfdf62f4e6d1826cc1bbcd9b51f94a2fb775d57dc667098d3fe13b" exitCode=0 Jun 11 23:10:42.605448 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.605360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerDied","Data":"b08e185267bfdf62f4e6d1826cc1bbcd9b51f94a2fb775d57dc667098d3fe13b"} Jun 11 23:10:42.636827 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:42.636772 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-x7288" podStartSLOduration=3.7686698659999998 podStartE2EDuration="4.636756188s" totalImagesPullingTime="868.086322ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:42.635923391 +0000 UTC m=+40.721849956" watchObservedRunningTime="2026-06-11 23:10:42.636756188 +0000 UTC m=+40.722682749" Jun 11 23:10:43.609164 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:43.609129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" event={"ID":"3ccd2f6b-fd2b-4b88-83ac-ad8ee049b63a","Type":"ContainerStarted","Data":"aba7ba3af9bacde2faa0e8a7d6ed257149a6fec326155ba56897a00c4307e824"} Jun 11 23:10:43.612425 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:43.612396 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" event={"ID":"17161d73-8451-4b27-8427-170033f90348","Type":"ContainerStarted","Data":"ae60fcab1bb1c1f0580fd14028b3d92826bf3a5259fb31e0921642b16a8028d9"} Jun 11 23:10:43.639456 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:43.639410 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-xfsrt" podStartSLOduration=1.8717332020000002 podStartE2EDuration="3.639396775s" totalImagesPullingTime="1.767663573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:43.639186747 +0000 UTC m=+41.725113327" watchObservedRunningTime="2026-06-11 23:10:43.639396775 +0000 UTC m=+41.725323337" Jun 11 23:10:45.068614 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:45.068554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:45.069059 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:45.068630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:45.069059 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:45.068733 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:10:45.069059 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:45.068760 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b58c89b9-vqpg4: secret "image-registry-tls" not found Jun 11 23:10:45.069059 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:45.068774 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:45.069059 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:45.068837 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls podName:bdba22a5-6e6a-49f8-9051-2cd01ec03ff9 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:53.068824026 +0000 UTC m=+51.154750570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls") pod "dns-default-m4k4n" (UID: "bdba22a5-6e6a-49f8-9051-2cd01ec03ff9") : secret "dns-default-metrics-tls" not found Jun 11 23:10:45.069059 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:45.068849 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls podName:f1f7b4e8-e910-46f8-9a3b-862f8e1200b4 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:53.068843621 +0000 UTC m=+51.154770161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls") pod "image-registry-68b58c89b9-vqpg4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4") : secret "image-registry-tls" not found Jun 11 23:10:46.579859 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:46.579820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:46.580247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:46.579876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:46.580247 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:46.579957 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:10:46.580247 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:46.579982 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:10:46.580247 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:46.580011 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:54.579998537 +0000 UTC m=+52.665925077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : configmap "kube-rbac-proxy" not found Jun 11 23:10:46.580247 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:10:46.580037 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls podName:ce770529-f3b3-4a07-aaf6-e08b2b76f30d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:54.580024539 +0000 UTC m=+52.665951079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wn5bv" (UID: "ce770529-f3b3-4a07-aaf6-e08b2b76f30d") : secret "insights-runtime-extractor-tls" not found Jun 11 23:10:53.135346 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.135302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:53.135841 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.135367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:53.138939 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.138915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"image-registry-68b58c89b9-vqpg4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:53.139013 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.138925 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdba22a5-6e6a-49f8-9051-2cd01ec03ff9-metrics-tls\") pod \"dns-default-m4k4n\" (UID: \"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9\") " pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:53.163932 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.163895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:53.209830 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.209800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:53.346700 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.346530 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k9kxr" podStartSLOduration=19.835501242 podStartE2EDuration="51.346504568s" totalImagesPullingTime="31.511003326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:43.681266611 +0000 UTC m=+41.767193175" watchObservedRunningTime="2026-06-11 23:10:53.346504568 +0000 UTC m=+51.432431132" Jun 11 23:10:53.347469 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.347437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b58c89b9-vqpg4"] Jun 11 23:10:53.351111 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:53.351080 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f7b4e8_e910_46f8_9a3b_862f8e1200b4.slice/crio-36abecfe5fb1c19cf2003c051cef814036d861a5d90c575da031f380438609ac WatchSource:0}: Error finding container 36abecfe5fb1c19cf2003c051cef814036d861a5d90c575da031f380438609ac: Status 404 returned error can't find the container with id 36abecfe5fb1c19cf2003c051cef814036d861a5d90c575da031f380438609ac Jun 11 23:10:53.381809 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.381773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m4k4n"] Jun 11 23:10:53.385380 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:53.385306 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdba22a5_6e6a_49f8_9051_2cd01ec03ff9.slice/crio-39124a1287c048f33e44379339e05008ebb35d7861fd8d256842c7ae4b928e41 WatchSource:0}: Error finding container 39124a1287c048f33e44379339e05008ebb35d7861fd8d256842c7ae4b928e41: Status 404 returned error can't find the container with id 39124a1287c048f33e44379339e05008ebb35d7861fd8d256842c7ae4b928e41 Jun 11 23:10:53.642170 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.642079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" event={"ID":"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4","Type":"ContainerStarted","Data":"83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f"} Jun 11 23:10:53.642170 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.642139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" event={"ID":"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4","Type":"ContainerStarted","Data":"36abecfe5fb1c19cf2003c051cef814036d861a5d90c575da031f380438609ac"} Jun 11 23:10:53.642170 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.642168 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:10:53.643491 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:53.643463 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m4k4n" event={"ID":"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9","Type":"ContainerStarted","Data":"39124a1287c048f33e44379339e05008ebb35d7861fd8d256842c7ae4b928e41"} Jun 11 23:10:54.647506 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:54.647472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:54.647907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:54.647525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:54.647978 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:54.647958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:54.649817 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:54.649795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce770529-f3b3-4a07-aaf6-e08b2b76f30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn5bv\" (UID: \"ce770529-f3b3-4a07-aaf6-e08b2b76f30d\") " pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:54.722614 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:54.722581 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wn5bv" Jun 11 23:10:55.285246 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:55.285164 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" podStartSLOduration=25.285147503 podStartE2EDuration="25.285147503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:53.678004949 +0000 UTC m=+51.763931521" watchObservedRunningTime="2026-06-11 23:10:55.285147503 +0000 UTC m=+53.371074047" Jun 11 23:10:55.285875 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:55.285851 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wn5bv"] Jun 11 23:10:55.288385 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:10:55.288361 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce770529_f3b3_4a07_aaf6_e08b2b76f30d.slice/crio-dcc40eeab054f49d3bff32d9642e3b757a4e9ca99ade480fdb3586d803ed89ae WatchSource:0}: Error finding container dcc40eeab054f49d3bff32d9642e3b757a4e9ca99ade480fdb3586d803ed89ae: Status 404 returned error can't find the container with id dcc40eeab054f49d3bff32d9642e3b757a4e9ca99ade480fdb3586d803ed89ae Jun 11 23:10:55.652524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:55.652493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m4k4n" event={"ID":"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9","Type":"ContainerStarted","Data":"b12077d9f2189db126d22720a49a9d31b61b35ea108911b8366ccc8c37ac7cc0"} Jun 11 23:10:55.654356 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:55.654327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn5bv" event={"ID":"ce770529-f3b3-4a07-aaf6-e08b2b76f30d","Type":"ContainerStarted","Data":"dcc40eeab054f49d3bff32d9642e3b757a4e9ca99ade480fdb3586d803ed89ae"} Jun 11 23:10:56.660388 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:56.660351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m4k4n" event={"ID":"bdba22a5-6e6a-49f8-9051-2cd01ec03ff9","Type":"ContainerStarted","Data":"0e381415278651f779d0aeb16d8c6ea46d2bc214501d60cec62c404954c7e0b3"} Jun 11 23:10:56.660843 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:56.660490 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m4k4n" Jun 11 23:10:56.684304 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:10:56.684246 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m4k4n" podStartSLOduration=17.643104632 podStartE2EDuration="19.684225503s" totalImagesPullingTime="2.041120871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:56.682834074 +0000 UTC m=+54.768760642" watchObservedRunningTime="2026-06-11 23:10:56.684225503 +0000 UTC m=+54.770152066" Jun 11 23:11:00.676874 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:00.676842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn5bv" event={"ID":"ce770529-f3b3-4a07-aaf6-e08b2b76f30d","Type":"ContainerStarted","Data":"6be2fc0f9beb8526484e41f55c7f8c0459e4b90ed48aa195978b6ae512f567ae"} Jun 11 23:11:00.677265 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:00.676907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn5bv" event={"ID":"ce770529-f3b3-4a07-aaf6-e08b2b76f30d","Type":"ContainerStarted","Data":"77f33c9d6fada9bff3aef6f86f64258f462562fbe8cb289efcb98579b48c1d18"} Jun 11 23:11:01.803591 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.803543 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-w4hqz"] Jun 11 23:11:01.806311 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.806291 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd"] Jun 11 23:11:01.806420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.806405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:01.808526 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.808501 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs"] Jun 11 23:11:01.808649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.808630 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.810260 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.810243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:01.811468 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.811447 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 23:11:01.816676 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.816652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ktl5x\"" Jun 11 23:11:01.816899 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.816882 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 23:11:01.816981 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.816958 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 23:11:01.817258 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.817238 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 23:11:01.817358 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.817320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 23:11:01.817640 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.817622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 23:11:01.817836 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.817819 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 23:11:01.818188 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.818172 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b58c89b9-vqpg4"] Jun 11 23:11:01.820260 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.820238 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 23:11:01.821868 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.821845 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 23:11:01.822071 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.822053 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 23:11:01.837066 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.837045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-w4hqz"] Jun 11 23:11:01.837991 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.837970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs"] Jun 11 23:11:01.838663 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.838644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd"] Jun 11 23:11:01.915572 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.915718 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.915718 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-ca\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.915718 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7ckx\" (UniqueName: \"kubernetes.io/projected/918b2327-64dd-4c17-8057-efbae8196667-kube-api-access-g7ckx\") pod \"downloads-694c955b9-w4hqz\" (UID: \"918b2327-64dd-4c17-8057-efbae8196667\") " pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:01.915718 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsjpd\" (UniqueName: \"kubernetes.io/projected/429a2e0c-c681-424c-b965-10e6ad570148-kube-api-access-zsjpd\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:01.915718 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-hub\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.915897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.915897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl6bh\" (UniqueName: \"kubernetes.io/projected/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-kube-api-access-sl6bh\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:01.915897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/429a2e0c-c681-424c-b965-10e6ad570148-tmp\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:01.915897 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.915863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/429a2e0c-c681-424c-b965-10e6ad570148-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:01.920524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.920500 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76c955587f-z2gfz"] Jun 11 23:11:01.922435 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.922422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:01.950271 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:01.950242 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c955587f-z2gfz"] Jun 11 23:11:02.017032 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.016962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.017032 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-bound-sa-token\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017032 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-image-registry-private-configuration\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017202 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl6bh\" (UniqueName: \"kubernetes.io/projected/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-kube-api-access-sl6bh\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.017202 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/429a2e0c-c681-424c-b965-10e6ad570148-tmp\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.017272 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-ca-trust-extracted\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017272 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/429a2e0c-c681-424c-b965-10e6ad570148-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.017272 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-registry-certificates\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.017420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-installation-pull-secrets\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.017601 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-ca\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.017601 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7ckx\" (UniqueName: \"kubernetes.io/projected/918b2327-64dd-4c17-8057-efbae8196667-kube-api-access-g7ckx\") pod \"downloads-694c955b9-w4hqz\" (UID: \"918b2327-64dd-4c17-8057-efbae8196667\") " pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:02.017601 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-trusted-ca\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017769 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsjpd\" (UniqueName: \"kubernetes.io/projected/429a2e0c-c681-424c-b965-10e6ad570148-kube-api-access-zsjpd\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.017769 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-registry-tls\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017769 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/429a2e0c-c681-424c-b965-10e6ad570148-tmp\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.017769 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj4jc\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-kube-api-access-mj4jc\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.017769 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.017727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-hub\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.018484 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.018442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.019871 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.019846 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.019964 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.019910 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.020142 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.020122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-hub\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.020422 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.020403 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-ca\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.020485 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.020462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/429a2e0c-c681-424c-b965-10e6ad570148-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.036577 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.036545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl6bh\" (UniqueName: \"kubernetes.io/projected/d43c8b72-83c7-4ffe-97c6-f9c74c5c9504-kube-api-access-sl6bh\") pod \"cluster-proxy-proxy-agent-6f5b64b788-5nsgd\" (UID: \"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.036978 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.036961 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7ckx\" (UniqueName: \"kubernetes.io/projected/918b2327-64dd-4c17-8057-efbae8196667-kube-api-access-g7ckx\") pod \"downloads-694c955b9-w4hqz\" (UID: \"918b2327-64dd-4c17-8057-efbae8196667\") " pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:02.039134 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.039118 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsjpd\" (UniqueName: \"kubernetes.io/projected/429a2e0c-c681-424c-b965-10e6ad570148-kube-api-access-zsjpd\") pod \"klusterlet-addon-workmgr-74d6595dff-kvwvs\" (UID: \"429a2e0c-c681-424c-b965-10e6ad570148\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.118235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-trusted-ca\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118235 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-registry-tls\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj4jc\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-kube-api-access-mj4jc\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-bound-sa-token\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-image-registry-private-configuration\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-ca-trust-extracted\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-registry-certificates\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118420 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-installation-pull-secrets\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.118890 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.118857 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-ca-trust-extracted\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.119216 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.119197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-registry-certificates\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.119714 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.119689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-trusted-ca\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.120644 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.120623 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-registry-tls\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.120798 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.120766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-image-registry-private-configuration\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.121122 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.121100 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-installation-pull-secrets\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.125004 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.124991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:02.132950 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.132929 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj4jc\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-kube-api-access-mj4jc\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.136515 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.136494 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cb1a3c2-b209-4c75-b4ac-57281e7d2e99-bound-sa-token\") pod \"image-registry-76c955587f-z2gfz\" (UID: \"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99\") " pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.140419 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.140396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" Jun 11 23:11:02.146616 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.146594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:02.230905 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.230841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.297442 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.297307 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-w4hqz"] Jun 11 23:11:02.302071 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.302004 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd"] Jun 11 23:11:02.305741 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:02.305705 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918b2327_64dd_4c17_8057_efbae8196667.slice/crio-b6335e2a38a668c07fc7ee0948f43369edc5920f3a652ebc0fc6fc0d137df1eb WatchSource:0}: Error finding container b6335e2a38a668c07fc7ee0948f43369edc5920f3a652ebc0fc6fc0d137df1eb: Status 404 returned error can't find the container with id b6335e2a38a668c07fc7ee0948f43369edc5920f3a652ebc0fc6fc0d137df1eb Jun 11 23:11:02.306231 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:02.306192 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd43c8b72_83c7_4ffe_97c6_f9c74c5c9504.slice/crio-9f42bdd64c3dcc86f63ede9da1f17234b0ffc59ffbe34831ecb9f914fb50a765 WatchSource:0}: Error finding container 9f42bdd64c3dcc86f63ede9da1f17234b0ffc59ffbe34831ecb9f914fb50a765: Status 404 returned error can't find the container with id 9f42bdd64c3dcc86f63ede9da1f17234b0ffc59ffbe34831ecb9f914fb50a765 Jun 11 23:11:02.325552 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.325528 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs"] Jun 11 23:11:02.328269 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:02.328238 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429a2e0c_c681_424c_b965_10e6ad570148.slice/crio-6d5997678c9a0a0dc4cd9b338fc4326bfed5fe37465e5caf10f9b423aafd697a WatchSource:0}: Error finding container 6d5997678c9a0a0dc4cd9b338fc4326bfed5fe37465e5caf10f9b423aafd697a: Status 404 returned error can't find the container with id 6d5997678c9a0a0dc4cd9b338fc4326bfed5fe37465e5caf10f9b423aafd697a Jun 11 23:11:02.386171 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.386140 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c955587f-z2gfz"] Jun 11 23:11:02.388836 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:02.388810 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb1a3c2_b209_4c75_b4ac_57281e7d2e99.slice/crio-d3910d774475168042404b4ee8bac29f5651096da13aa76f638ab0ce856cc9da WatchSource:0}: Error finding container d3910d774475168042404b4ee8bac29f5651096da13aa76f638ab0ce856cc9da: Status 404 returned error can't find the container with id d3910d774475168042404b4ee8bac29f5651096da13aa76f638ab0ce856cc9da Jun 11 23:11:02.689854 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.689811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-w4hqz" event={"ID":"918b2327-64dd-4c17-8057-efbae8196667","Type":"ContainerStarted","Data":"b6335e2a38a668c07fc7ee0948f43369edc5920f3a652ebc0fc6fc0d137df1eb"} Jun 11 23:11:02.691869 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.691836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn5bv" event={"ID":"ce770529-f3b3-4a07-aaf6-e08b2b76f30d","Type":"ContainerStarted","Data":"ee1f8c95723158bad66d60745100c8ebecb5280811d5686a5452d469be0f847c"} Jun 11 23:11:02.693318 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.693294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" event={"ID":"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99","Type":"ContainerStarted","Data":"8ee6a8ec18e6141c1c2816c57d81d5e4e714eecb995d91419c077d286aa45c1f"} Jun 11 23:11:02.693455 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.693330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" event={"ID":"7cb1a3c2-b209-4c75-b4ac-57281e7d2e99","Type":"ContainerStarted","Data":"d3910d774475168042404b4ee8bac29f5651096da13aa76f638ab0ce856cc9da"} Jun 11 23:11:02.693455 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.693365 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:02.694606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.694583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" event={"ID":"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504","Type":"ContainerStarted","Data":"9f42bdd64c3dcc86f63ede9da1f17234b0ffc59ffbe34831ecb9f914fb50a765"} Jun 11 23:11:02.695749 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.695730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" event={"ID":"429a2e0c-c681-424c-b965-10e6ad570148","Type":"ContainerStarted","Data":"6d5997678c9a0a0dc4cd9b338fc4326bfed5fe37465e5caf10f9b423aafd697a"} Jun 11 23:11:02.711941 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.711896 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wn5bv" podStartSLOduration=18.392515129 podStartE2EDuration="24.711881069s" totalImagesPullingTime="6.31936594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:02.710836744 +0000 UTC m=+60.796763306" watchObservedRunningTime="2026-06-11 23:11:02.711881069 +0000 UTC m=+60.797807656" Jun 11 23:11:02.731750 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:02.731702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" podStartSLOduration=1.731682599 podStartE2EDuration="1.731682599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:02.730927375 +0000 UTC m=+60.816853948" watchObservedRunningTime="2026-06-11 23:11:02.731682599 +0000 UTC m=+60.817609162" Jun 11 23:11:03.589016 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:03.587584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2qzv" Jun 11 23:11:06.667832 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:06.667220 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m4k4n" Jun 11 23:11:08.179795 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.179754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:11:08.182360 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.182332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:11:08.193197 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.193165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446c6a64-0dd1-4c08-a064-e6a93dba48de-metrics-certs\") pod \"network-metrics-daemon-qzdgl\" (UID: \"446c6a64-0dd1-4c08-a064-e6a93dba48de\") " pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:11:08.280810 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.280765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:11:08.281008 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.280889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:11:08.283709 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.283308 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:11:08.283709 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.283544 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:11:08.294074 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.293910 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:11:08.295841 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.295815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16a33568-12c5-418e-9824-4dd48eaa26c7-original-pull-secret\") pod \"global-pull-secret-syncer-mtknb\" (UID: \"16a33568-12c5-418e-9824-4dd48eaa26c7\") " pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:11:08.305104 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.305045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xw7l\" (UniqueName: \"kubernetes.io/projected/2d421816-8f40-44a6-ba2c-6d06e0721597-kube-api-access-5xw7l\") pod \"network-check-target-px9qb\" (UID: \"2d421816-8f40-44a6-ba2c-6d06e0721597\") " pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:11:08.320155 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.320125 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8q79j\"" Jun 11 23:11:08.325318 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.325290 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtknb" Jun 11 23:11:08.328705 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.328684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:11:08.332206 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.332185 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5cps\"" Jun 11 23:11:08.341048 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.341016 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzdgl" Jun 11 23:11:08.568513 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:08.568465 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d421816_8f40_44a6_ba2c_6d06e0721597.slice/crio-b72af65f5ab0329c250146d1c3f6ee7fff71f6daba73feb9dbae897f6306ba71 WatchSource:0}: Error finding container b72af65f5ab0329c250146d1c3f6ee7fff71f6daba73feb9dbae897f6306ba71: Status 404 returned error can't find the container with id b72af65f5ab0329c250146d1c3f6ee7fff71f6daba73feb9dbae897f6306ba71 Jun 11 23:11:08.569731 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.568547 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-px9qb"] Jun 11 23:11:08.586457 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.586434 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtknb"] Jun 11 23:11:08.589405 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.589378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qzdgl"] Jun 11 23:11:08.590884 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:08.590854 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a33568_12c5_418e_9824_4dd48eaa26c7.slice/crio-9e0c325feb6695b397435b5dd0da6d657b6566c33b61fd8cac64ba704951152f WatchSource:0}: Error finding container 9e0c325feb6695b397435b5dd0da6d657b6566c33b61fd8cac64ba704951152f: Status 404 returned error can't find the container with id 9e0c325feb6695b397435b5dd0da6d657b6566c33b61fd8cac64ba704951152f Jun 11 23:11:08.594305 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:08.594276 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446c6a64_0dd1_4c08_a064_e6a93dba48de.slice/crio-b85760976476dd363f68b8ae85e6fede1a9f00b77e69139a1946a68741b5a464 WatchSource:0}: Error finding container b85760976476dd363f68b8ae85e6fede1a9f00b77e69139a1946a68741b5a464: Status 404 returned error can't find the container with id b85760976476dd363f68b8ae85e6fede1a9f00b77e69139a1946a68741b5a464 Jun 11 23:11:08.740813 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.740705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" event={"ID":"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504","Type":"ContainerStarted","Data":"034ee9322a755b38f6a0ec3964e55f24d6daa953151254e82826d6aaab44a588"} Jun 11 23:11:08.740813 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.740781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" event={"ID":"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504","Type":"ContainerStarted","Data":"2326841c2aba124c4e197914b694cd6b794ad0dab481fc5f31ef670db8a36609"} Jun 11 23:11:08.740813 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.740797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" event={"ID":"d43c8b72-83c7-4ffe-97c6-f9c74c5c9504","Type":"ContainerStarted","Data":"4b7a30605f99c5e5c8cd5b7154eceabca6756d1bba0d61e14558ced12c5507c2"} Jun 11 23:11:08.742425 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.742394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-px9qb" event={"ID":"2d421816-8f40-44a6-ba2c-6d06e0721597","Type":"ContainerStarted","Data":"b72af65f5ab0329c250146d1c3f6ee7fff71f6daba73feb9dbae897f6306ba71"} Jun 11 23:11:08.744154 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.744126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" event={"ID":"429a2e0c-c681-424c-b965-10e6ad570148","Type":"ContainerStarted","Data":"c5be285eba09dd89be981e8ff09b69d66e210b476af2e2cd78908f2a058c6e0b"} Jun 11 23:11:08.744789 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.744761 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:08.745907 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.745879 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtknb" event={"ID":"16a33568-12c5-418e-9824-4dd48eaa26c7","Type":"ContainerStarted","Data":"9e0c325feb6695b397435b5dd0da6d657b6566c33b61fd8cac64ba704951152f"} Jun 11 23:11:08.746721 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.746699 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" Jun 11 23:11:08.747220 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.747176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzdgl" event={"ID":"446c6a64-0dd1-4c08-a064-e6a93dba48de","Type":"ContainerStarted","Data":"b85760976476dd363f68b8ae85e6fede1a9f00b77e69139a1946a68741b5a464"} Jun 11 23:11:08.763127 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.763072 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5b64b788-5nsgd" podStartSLOduration=1.6867430799999998 podStartE2EDuration="7.763054886s" totalImagesPullingTime="6.076311806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:08.762101972 +0000 UTC m=+66.848028554" watchObservedRunningTime="2026-06-11 23:11:08.763054886 +0000 UTC m=+66.848981463" Jun 11 23:11:08.780598 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:08.780214 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d6595dff-kvwvs" podStartSLOduration=1.722523499 podStartE2EDuration="7.780194282s" totalImagesPullingTime="6.057670783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:08.77959414 +0000 UTC m=+66.865520715" watchObservedRunningTime="2026-06-11 23:11:08.780194282 +0000 UTC m=+66.866120875" Jun 11 23:11:10.760660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:10.760208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzdgl" event={"ID":"446c6a64-0dd1-4c08-a064-e6a93dba48de","Type":"ContainerStarted","Data":"773ed436f76c8ad4187c11a776d3e06ab31dabfd1dbdc403c820100db45473f4"} Jun 11 23:11:10.760660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:10.760277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzdgl" event={"ID":"446c6a64-0dd1-4c08-a064-e6a93dba48de","Type":"ContainerStarted","Data":"1415dcad75ca7f41d686c15dbf6d22c8f68e23f5d699d8b3e0198f161e260b07"} Jun 11 23:11:11.826288 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:11.826243 2581 patch_prober.go:28] interesting pod/image-registry-68b58c89b9-vqpg4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:11:11.826696 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:11.826311 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" podUID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:11:18.693425 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.693350 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qzdgl" podStartSLOduration=75.409503473 podStartE2EDuration="1m16.693327498s" totalImagesPullingTime="1.283824025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:10.802142469 +0000 UTC m=+68.888069054" watchObservedRunningTime="2026-06-11 23:11:18.693327498 +0000 UTC m=+76.779254063" Jun 11 23:11:18.694400 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.694383 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vtn6z"] Jun 11 23:11:18.819244 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.819208 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.821769 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.821743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 23:11:18.822977 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.822958 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6x6hf\"" Jun 11 23:11:18.823095 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.823020 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 23:11:18.823212 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.823195 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 23:11:18.823321 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.823305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 23:11:18.823488 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.823475 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 23:11:18.823673 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.823659 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 23:11:18.978660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-sys\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6bc0434-f9bf-412a-bdd9-c03178d87e83-metrics-client-ca\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-textfile\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-root\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-wtmp\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm2nf\" (UniqueName: \"kubernetes.io/projected/b6bc0434-f9bf-412a-bdd9-c03178d87e83-kube-api-access-hm2nf\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:18.978919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:18.978784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-tls\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080215 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-sys\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080372 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6bc0434-f9bf-412a-bdd9-c03178d87e83-metrics-client-ca\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080372 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-textfile\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080372 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-root\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080372 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080288 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-sys\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080372 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-wtmp\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080372 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm2nf\" (UniqueName: \"kubernetes.io/projected/b6bc0434-f9bf-412a-bdd9-c03178d87e83-kube-api-access-hm2nf\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080634 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080634 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080634 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-tls\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080634 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:11:19.080626 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 23:11:19.080812 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-textfile\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080812 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080685 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-root\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080812 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:11:19.080700 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-tls podName:b6bc0434-f9bf-412a-bdd9-c03178d87e83 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:19.580680738 +0000 UTC m=+77.666607285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-tls") pod "node-exporter-vtn6z" (UID: "b6bc0434-f9bf-412a-bdd9-c03178d87e83") : secret "node-exporter-tls" not found Jun 11 23:11:19.080938 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080832 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-wtmp\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.080938 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.080878 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6bc0434-f9bf-412a-bdd9-c03178d87e83-metrics-client-ca\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.081119 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.081091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.083465 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.083437 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.092645 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.092618 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm2nf\" (UniqueName: \"kubernetes.io/projected/b6bc0434-f9bf-412a-bdd9-c03178d87e83-kube-api-access-hm2nf\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.584671 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.584622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-tls\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.587693 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.587669 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6bc0434-f9bf-412a-bdd9-c03178d87e83-node-exporter-tls\") pod \"node-exporter-vtn6z\" (UID: \"b6bc0434-f9bf-412a-bdd9-c03178d87e83\") " pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:19.733127 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:19.733086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vtn6z" Jun 11 23:11:21.719493 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:11:21.718110 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6bc0434_f9bf_412a_bdd9_c03178d87e83.slice/crio-232af3f17329f2f302e33b7c28cd720145726afb5095268199c2a6612f5e2d95 WatchSource:0}: Error finding container 232af3f17329f2f302e33b7c28cd720145726afb5095268199c2a6612f5e2d95: Status 404 returned error can't find the container with id 232af3f17329f2f302e33b7c28cd720145726afb5095268199c2a6612f5e2d95 Jun 11 23:11:21.808701 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:21.808672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtn6z" event={"ID":"b6bc0434-f9bf-412a-bdd9-c03178d87e83","Type":"ContainerStarted","Data":"232af3f17329f2f302e33b7c28cd720145726afb5095268199c2a6612f5e2d95"} Jun 11 23:11:21.824699 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:21.824464 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:11:22.814816 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.814781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-px9qb" event={"ID":"2d421816-8f40-44a6-ba2c-6d06e0721597","Type":"ContainerStarted","Data":"fc546e9a701ba2a2d690b510fb6ec9431bf0203acd3b4d547bd5ed423c4f95a0"} Jun 11 23:11:22.815315 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.814893 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:11:22.816745 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.816719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtknb" event={"ID":"16a33568-12c5-418e-9824-4dd48eaa26c7","Type":"ContainerStarted","Data":"7579f7a5c2a9fbb391f8211b8986551b46424e316c5d7ed41b2a67724a090af0"} Jun 11 23:11:22.818940 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.818913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-w4hqz" event={"ID":"918b2327-64dd-4c17-8057-efbae8196667","Type":"ContainerStarted","Data":"866c4498d1c9cae9839bbda65dcf11576f7649d4bb0de66e289a7ee9fd48b2b5"} Jun 11 23:11:22.819343 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.819323 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:22.834612 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.834584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-w4hqz" Jun 11 23:11:22.838133 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.838082 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-px9qb" podStartSLOduration=67.696291821 podStartE2EDuration="1m20.838067062s" totalImagesPullingTime="13.141775241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:22.836852447 +0000 UTC m=+80.922779009" watchObservedRunningTime="2026-06-11 23:11:22.838067062 +0000 UTC m=+80.923993624" Jun 11 23:11:22.873203 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.873145 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtknb" podStartSLOduration=67.752241851 podStartE2EDuration="1m20.873130508s" totalImagesPullingTime="13.120888657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:22.870006955 +0000 UTC m=+80.955933520" watchObservedRunningTime="2026-06-11 23:11:22.873130508 +0000 UTC m=+80.959057069" Jun 11 23:11:22.895678 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:22.895633 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-w4hqz" podStartSLOduration=2.423017777 podStartE2EDuration="21.895598758s" totalImagesPullingTime="19.472580981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:22.894065709 +0000 UTC m=+80.979992275" watchObservedRunningTime="2026-06-11 23:11:22.895598758 +0000 UTC m=+80.981525319" Jun 11 23:11:23.709603 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:23.709506 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76c955587f-z2gfz" Jun 11 23:11:23.834540 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:23.834501 2581 generic.go:356] "Generic (PLEG): container finished" podID="b6bc0434-f9bf-412a-bdd9-c03178d87e83" containerID="2df3b9aa6748f382fefaebd89b758925fbc51b0c26196b7b0786e351a6b8e640" exitCode=0 Jun 11 23:11:23.835216 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:23.834607 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtn6z" event={"ID":"b6bc0434-f9bf-412a-bdd9-c03178d87e83","Type":"ContainerDied","Data":"2df3b9aa6748f382fefaebd89b758925fbc51b0c26196b7b0786e351a6b8e640"} Jun 11 23:11:24.842959 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:24.842921 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtn6z" event={"ID":"b6bc0434-f9bf-412a-bdd9-c03178d87e83","Type":"ContainerStarted","Data":"87993f01426dc830486f66116d034f824ffe0689e86b5a21015a4a0dc3b3ac14"} Jun 11 23:11:24.843410 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:24.842997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtn6z" event={"ID":"b6bc0434-f9bf-412a-bdd9-c03178d87e83","Type":"ContainerStarted","Data":"c7ad60063e81ff9f388e57fb31ee42e8f6f0920b9e4f9580f6270c246b0926c5"} Jun 11 23:11:24.882896 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:24.882827 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vtn6z" podStartSLOduration=5.298429856 podStartE2EDuration="6.882806154s" totalImagesPullingTime="1.464974912s" totalInitContainerRuntime="119.401386ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:24.880438439 +0000 UTC m=+82.966365025" watchObservedRunningTime="2026-06-11 23:11:24.882806154 +0000 UTC m=+82.968732717" Jun 11 23:11:26.840230 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:26.840185 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" podUID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" containerName="registry" containerID="cri-o://83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f" gracePeriod=30 Jun 11 23:11:27.145271 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.145238 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:11:27.260400 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260365 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-installation-pull-secrets\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260411 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-certificates\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260443 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-ca-trust-extracted\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260474 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260496 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-trusted-ca\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260537 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fldl\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-kube-api-access-4fldl\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260606 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-image-registry-private-configuration\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.260649 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.260647 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-bound-sa-token\") pod \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\" (UID: \"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4\") " Jun 11 23:11:27.261286 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.261071 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:27.261951 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.261917 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:27.263338 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.263283 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:11:27.263602 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.263529 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:11:27.264116 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.264090 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:11:27.266411 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.266372 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-kube-api-access-4fldl" (OuterVolumeSpecName: "kube-api-access-4fldl") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "kube-api-access-4fldl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:11:27.266604 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.266574 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:11:27.271729 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.271705 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" (UID: "f1f7b4e8-e910-46f8-9a3b-862f8e1200b4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:11:27.361546 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361512 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fldl\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-kube-api-access-4fldl\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361554 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-image-registry-private-configuration\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361599 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-bound-sa-token\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361611 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-installation-pull-secrets\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361624 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-certificates\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361638 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-ca-trust-extracted\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361648 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-registry-tls\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.361761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.361656 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4-trusted-ca\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:11:27.857186 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.857151 2581 generic.go:356] "Generic (PLEG): container finished" podID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" containerID="83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f" exitCode=0 Jun 11 23:11:27.857739 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.857203 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" Jun 11 23:11:27.857739 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.857248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" event={"ID":"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4","Type":"ContainerDied","Data":"83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f"} Jun 11 23:11:27.857739 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.857306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b58c89b9-vqpg4" event={"ID":"f1f7b4e8-e910-46f8-9a3b-862f8e1200b4","Type":"ContainerDied","Data":"36abecfe5fb1c19cf2003c051cef814036d861a5d90c575da031f380438609ac"} Jun 11 23:11:27.869043 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.869016 2581 scope.go:117] "RemoveContainer" containerID="83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f" Jun 11 23:11:27.878725 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.878698 2581 scope.go:117] "RemoveContainer" containerID="83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f" Jun 11 23:11:27.879030 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:11:27.879000 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f\": container with ID starting with 83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f not found: ID does not exist" containerID="83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f" Jun 11 23:11:27.879126 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.879040 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f"} err="failed to get container status \"83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f\": rpc error: code = NotFound desc = could not find container \"83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f\": container with ID starting with 83d1953c5fe956e135d9ad3f2c68e11f717ade703744abcc3506e869dd4c4e0f not found: ID does not exist" Jun 11 23:11:27.879960 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.879934 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b58c89b9-vqpg4"] Jun 11 23:11:27.883768 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:27.883743 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68b58c89b9-vqpg4"] Jun 11 23:11:28.410443 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:28.410404 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" path="/var/lib/kubelet/pods/f1f7b4e8-e910-46f8-9a3b-862f8e1200b4/volumes" Jun 11 23:11:44.307857 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:44.307823 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjxht_480703bb-f7a8-4b45-807d-bf057019ec39/serve-healthcheck-canary/0.log" Jun 11 23:11:53.838129 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:11:53.838097 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-px9qb" Jun 11 23:15:02.356586 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:02.356519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:15:02.358171 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:02.358153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:15:02.359681 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:02.359663 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 23:15:57.378347 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.378311 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x"] Jun 11 23:15:57.378820 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.378552 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" containerName="registry" Jun 11 23:15:57.378820 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.378576 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" containerName="registry" Jun 11 23:15:57.378820 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.378622 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f7b4e8-e910-46f8-9a3b-862f8e1200b4" containerName="registry" Jun 11 23:15:57.380605 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.380587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.383428 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.383398 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:15:57.383539 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.383458 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:15:57.383919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.383896 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:15:57.384148 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.384133 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srt9d\"" Jun 11 23:15:57.384191 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.384168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:15:57.402810 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.402788 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x"] Jun 11 23:15:57.448998 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.448967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13656011-9fe5-472d-8129-1150e06d01a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.449156 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.449003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/13656011-9fe5-472d-8129-1150e06d01a8-manifests\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.449156 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.449032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwljd\" (UniqueName: \"kubernetes.io/projected/13656011-9fe5-472d-8129-1150e06d01a8-kube-api-access-mwljd\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.449156 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.449136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13656011-9fe5-472d-8129-1150e06d01a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.449262 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.449166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13656011-9fe5-472d-8129-1150e06d01a8-tmp\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.550528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.550481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13656011-9fe5-472d-8129-1150e06d01a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.550528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.550530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13656011-9fe5-472d-8129-1150e06d01a8-tmp\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.550804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.550555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13656011-9fe5-472d-8129-1150e06d01a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.550804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.550596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/13656011-9fe5-472d-8129-1150e06d01a8-manifests\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.550804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.550617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwljd\" (UniqueName: \"kubernetes.io/projected/13656011-9fe5-472d-8129-1150e06d01a8-kube-api-access-mwljd\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.551037 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.551017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/13656011-9fe5-472d-8129-1150e06d01a8-manifests\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.553113 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.553088 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13656011-9fe5-472d-8129-1150e06d01a8-tmp\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.553190 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.553135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13656011-9fe5-472d-8129-1150e06d01a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.553190 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.553180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13656011-9fe5-472d-8129-1150e06d01a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.560337 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.560317 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwljd\" (UniqueName: \"kubernetes.io/projected/13656011-9fe5-472d-8129-1150e06d01a8-kube-api-access-mwljd\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-zkz7x\" (UID: \"13656011-9fe5-472d-8129-1150e06d01a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.690548 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.690458 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:15:57.832989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.832957 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x"] Jun 11 23:15:57.836446 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:15:57.836421 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13656011_9fe5_472d_8129_1150e06d01a8.slice/crio-8b41cec07bb22f58bd3835e70d423b10b0ab37409cf7f6e138712ef53c4cd2c9 WatchSource:0}: Error finding container 8b41cec07bb22f58bd3835e70d423b10b0ab37409cf7f6e138712ef53c4cd2c9: Status 404 returned error can't find the container with id 8b41cec07bb22f58bd3835e70d423b10b0ab37409cf7f6e138712ef53c4cd2c9 Jun 11 23:15:57.838237 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:57.838219 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:15:58.743694 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:15:58.743549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" event={"ID":"13656011-9fe5-472d-8129-1150e06d01a8","Type":"ContainerStarted","Data":"8b41cec07bb22f58bd3835e70d423b10b0ab37409cf7f6e138712ef53c4cd2c9"} Jun 11 23:16:00.756311 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:00.756278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" event={"ID":"13656011-9fe5-472d-8129-1150e06d01a8","Type":"ContainerStarted","Data":"9eb723d36d591f6a4b9611ad6cb9054581e6c1455a763653517b49596b09e7da"} Jun 11 23:16:01.761178 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:01.761140 2581 generic.go:356] "Generic (PLEG): container finished" podID="13656011-9fe5-472d-8129-1150e06d01a8" containerID="9eb723d36d591f6a4b9611ad6cb9054581e6c1455a763653517b49596b09e7da" exitCode=0 Jun 11 23:16:01.761675 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:01.761230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" event={"ID":"13656011-9fe5-472d-8129-1150e06d01a8","Type":"ContainerDied","Data":"9eb723d36d591f6a4b9611ad6cb9054581e6c1455a763653517b49596b09e7da"} Jun 11 23:16:02.766880 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:02.766848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" event={"ID":"13656011-9fe5-472d-8129-1150e06d01a8","Type":"ContainerStarted","Data":"d9fecae0f2cca9eb9fba2b42b7dafde232353fcdbe180c7b9d801393818369fc"} Jun 11 23:16:02.767364 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:02.766971 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:16:02.791309 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:02.791254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" podStartSLOduration=1.825059848 podStartE2EDuration="5.791239004s" totalImagesPullingTime="3.053943829s" totalInitContainerRuntime="912.235327ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:02.790071654 +0000 UTC m=+360.875998216" watchObservedRunningTime="2026-06-11 23:16:02.791239004 +0000 UTC m=+360.877165566" Jun 11 23:16:13.778451 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:13.778414 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-zkz7x" Jun 11 23:16:16.852063 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.852020 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm"] Jun 11 23:16:16.861115 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.861090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:16.871467 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.871441 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 23:16:16.871629 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.871449 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:16:16.871828 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.871802 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 23:16:16.871923 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.871833 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:16:16.891740 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:16.891707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm"] Jun 11 23:16:17.005443 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.005404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvhs\" (UniqueName: \"kubernetes.io/projected/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-kube-api-access-hkvhs\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.005443 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.005447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-tls-certs\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.005658 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.005468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-tmp\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.106508 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.106475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvhs\" (UniqueName: \"kubernetes.io/projected/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-kube-api-access-hkvhs\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.106713 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.106529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-tls-certs\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.106713 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.106620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-tmp\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.108992 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.108965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-tmp\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.109207 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.109188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-tls-certs\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.123142 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.123110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvhs\" (UniqueName: \"kubernetes.io/projected/4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461-kube-api-access-hkvhs\") pod \"kube-auth-proxy-747776d6d8-ghwpm\" (UID: \"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.131696 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.131664 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ftq6j"] Jun 11 23:16:17.134875 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.134857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.140150 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.140129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 23:16:17.140254 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.140167 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-n7cvq\"" Jun 11 23:16:17.171276 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.170996 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" Jun 11 23:16:17.198044 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.198008 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ftq6j"] Jun 11 23:16:17.207736 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.207689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3858a7d-87b7-433c-9f52-1babb932ddf7-cert\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.207908 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.207779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xh6v\" (UniqueName: \"kubernetes.io/projected/c3858a7d-87b7-433c-9f52-1babb932ddf7-kube-api-access-2xh6v\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.308989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.308957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3858a7d-87b7-433c-9f52-1babb932ddf7-cert\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.309157 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.309003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xh6v\" (UniqueName: \"kubernetes.io/projected/c3858a7d-87b7-433c-9f52-1babb932ddf7-kube-api-access-2xh6v\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.309157 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:16:17.309121 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 23:16:17.309243 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:16:17.309209 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3858a7d-87b7-433c-9f52-1babb932ddf7-cert podName:c3858a7d-87b7-433c-9f52-1babb932ddf7 nodeName:}" failed. No retries permitted until 2026-06-11 23:16:17.80919294 +0000 UTC m=+375.895119480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3858a7d-87b7-433c-9f52-1babb932ddf7-cert") pod "odh-model-controller-6dc94f689f-ftq6j" (UID: "c3858a7d-87b7-433c-9f52-1babb932ddf7") : secret "odh-model-controller-webhook-cert" not found Jun 11 23:16:17.336577 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.336530 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xh6v\" (UniqueName: \"kubernetes.io/projected/c3858a7d-87b7-433c-9f52-1babb932ddf7-kube-api-access-2xh6v\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.356441 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.356415 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm"] Jun 11 23:16:17.363306 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:17.363278 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf7b2ac_36fd_4fbe_8674_ee3d3e9d3461.slice/crio-279daeb954d7166adf387e680dd5994e52e6df5fd4d719422b2b798c32828c9a WatchSource:0}: Error finding container 279daeb954d7166adf387e680dd5994e52e6df5fd4d719422b2b798c32828c9a: Status 404 returned error can't find the container with id 279daeb954d7166adf387e680dd5994e52e6df5fd4d719422b2b798c32828c9a Jun 11 23:16:17.813490 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.813393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3858a7d-87b7-433c-9f52-1babb932ddf7-cert\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.815949 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.815921 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3858a7d-87b7-433c-9f52-1babb932ddf7-cert\") pod \"odh-model-controller-6dc94f689f-ftq6j\" (UID: \"c3858a7d-87b7-433c-9f52-1babb932ddf7\") " pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:17.821694 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:17.821665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" event={"ID":"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461","Type":"ContainerStarted","Data":"279daeb954d7166adf387e680dd5994e52e6df5fd4d719422b2b798c32828c9a"} Jun 11 23:16:18.042364 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.042319 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6wsnc"] Jun 11 23:16:18.048024 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.046742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:18.051879 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.051859 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.057468 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.057437 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 23:16:18.063716 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.063630 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6wsnc"] Jun 11 23:16:18.117359 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.116501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssq9l\" (UniqueName: \"kubernetes.io/projected/e0f29d92-314f-4c72-bd3b-7ecaef321edb-kube-api-access-ssq9l\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.117359 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.116615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f29d92-314f-4c72-bd3b-7ecaef321edb-tls-certs\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.205255 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.205221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ftq6j"] Jun 11 23:16:18.208449 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:18.208417 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3858a7d_87b7_433c_9f52_1babb932ddf7.slice/crio-4748fea23eb8d583a265774a5b5beee084781edba80209220d979657689d22e1 WatchSource:0}: Error finding container 4748fea23eb8d583a265774a5b5beee084781edba80209220d979657689d22e1: Status 404 returned error can't find the container with id 4748fea23eb8d583a265774a5b5beee084781edba80209220d979657689d22e1 Jun 11 23:16:18.217417 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.217377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f29d92-314f-4c72-bd3b-7ecaef321edb-tls-certs\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.217539 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.217460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssq9l\" (UniqueName: \"kubernetes.io/projected/e0f29d92-314f-4c72-bd3b-7ecaef321edb-kube-api-access-ssq9l\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.217682 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:16:18.217661 2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 23:16:18.217807 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:16:18.217763 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f29d92-314f-4c72-bd3b-7ecaef321edb-tls-certs podName:e0f29d92-314f-4c72-bd3b-7ecaef321edb nodeName:}" failed. No retries permitted until 2026-06-11 23:16:18.717741251 +0000 UTC m=+376.803667798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e0f29d92-314f-4c72-bd3b-7ecaef321edb-tls-certs") pod "model-serving-api-5dd488fc48-6wsnc" (UID: "e0f29d92-314f-4c72-bd3b-7ecaef321edb") : secret "model-serving-api-tls" not found Jun 11 23:16:18.232660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.232529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssq9l\" (UniqueName: \"kubernetes.io/projected/e0f29d92-314f-4c72-bd3b-7ecaef321edb-kube-api-access-ssq9l\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.722961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.722919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f29d92-314f-4c72-bd3b-7ecaef321edb-tls-certs\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.726198 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.726147 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f29d92-314f-4c72-bd3b-7ecaef321edb-tls-certs\") pod \"model-serving-api-5dd488fc48-6wsnc\" (UID: \"e0f29d92-314f-4c72-bd3b-7ecaef321edb\") " pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:18.827256 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.827216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" event={"ID":"c3858a7d-87b7-433c-9f52-1babb932ddf7","Type":"ContainerStarted","Data":"4748fea23eb8d583a265774a5b5beee084781edba80209220d979657689d22e1"} Jun 11 23:16:18.965851 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:18.965809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:19.948059 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:19.948027 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6wsnc"] Jun 11 23:16:19.951062 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:19.951030 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f29d92_314f_4c72_bd3b_7ecaef321edb.slice/crio-0b58f86a8a0c9907cee01b2ccd49daa091fd2281235f36016c8b90842e772691 WatchSource:0}: Error finding container 0b58f86a8a0c9907cee01b2ccd49daa091fd2281235f36016c8b90842e772691: Status 404 returned error can't find the container with id 0b58f86a8a0c9907cee01b2ccd49daa091fd2281235f36016c8b90842e772691 Jun 11 23:16:20.842625 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:20.842578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" event={"ID":"e0f29d92-314f-4c72-bd3b-7ecaef321edb","Type":"ContainerStarted","Data":"0b58f86a8a0c9907cee01b2ccd49daa091fd2281235f36016c8b90842e772691"} Jun 11 23:16:23.857877 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.857840 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" event={"ID":"e0f29d92-314f-4c72-bd3b-7ecaef321edb","Type":"ContainerStarted","Data":"25d7d9bd12a72756fc70ab9cf24036a7805773b4ca6b114aee4dfe4dc0b8b15f"} Jun 11 23:16:23.858335 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.857932 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:23.859446 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.859419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" event={"ID":"4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461","Type":"ContainerStarted","Data":"a42e7107edd4bc9fa759d6a4fbec1d7012ad26eb2d3047a3b5b7465439ecdc3e"} Jun 11 23:16:23.860840 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.860814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" event={"ID":"c3858a7d-87b7-433c-9f52-1babb932ddf7","Type":"ContainerStarted","Data":"fea66e8a7e469dad8f2c763acb8199c918bf26e2753fb654a9f694b6779ef0ba"} Jun 11 23:16:23.860970 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.860956 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:23.874598 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.874539 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" podStartSLOduration=2.817853996 podStartE2EDuration="5.874525104s" totalImagesPullingTime="3.056671108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:23.874025583 +0000 UTC m=+381.959952146" watchObservedRunningTime="2026-06-11 23:16:23.874525104 +0000 UTC m=+381.960451665" Jun 11 23:16:23.890117 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.890058 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" podStartSLOduration=2.09401175 podStartE2EDuration="6.89004025s" totalImagesPullingTime="4.7960285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:23.888767668 +0000 UTC m=+381.974694233" watchObservedRunningTime="2026-06-11 23:16:23.89004025 +0000 UTC m=+381.975966813" Jun 11 23:16:23.905718 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:23.905666 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-747776d6d8-ghwpm" podStartSLOduration=2.25745308 podStartE2EDuration="7.905649925s" totalImagesPullingTime="5.648196845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:23.903613148 +0000 UTC m=+381.989539711" watchObservedRunningTime="2026-06-11 23:16:23.905649925 +0000 UTC m=+381.991576581" Jun 11 23:16:28.243921 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.243878 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-q4g76"] Jun 11 23:16:28.247480 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.247461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.250036 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.250013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-z5hsg\"" Jun 11 23:16:28.250708 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.250678 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc"] Jun 11 23:16:28.250922 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.250686 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 23:16:28.258108 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.258088 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.260935 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.260912 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 23:16:28.260935 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.260931 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nrktg\"" Jun 11 23:16:28.267762 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.267739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-q4g76"] Jun 11 23:16:28.287596 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.287540 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc"] Jun 11 23:16:28.417545 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.417510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7de1a033-ad8c-4d43-aba4-a77f24024876-cert\") pod \"kserve-controller-manager-69fc866d76-q4g76\" (UID: \"7de1a033-ad8c-4d43-aba4-a77f24024876\") " pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.417735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.417580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-882zs\" (UniqueName: \"kubernetes.io/projected/5fe5b788-7938-48a2-a24d-48ba9d3a3dc2-kube-api-access-882zs\") pod \"llmisvc-controller-manager-864bfd7bc9-jvdrc\" (UID: \"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.417735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.417613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmxl\" (UniqueName: \"kubernetes.io/projected/7de1a033-ad8c-4d43-aba4-a77f24024876-kube-api-access-4kmxl\") pod \"kserve-controller-manager-69fc866d76-q4g76\" (UID: \"7de1a033-ad8c-4d43-aba4-a77f24024876\") " pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.417735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.417695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe5b788-7938-48a2-a24d-48ba9d3a3dc2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jvdrc\" (UID: \"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.519154 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.519065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7de1a033-ad8c-4d43-aba4-a77f24024876-cert\") pod \"kserve-controller-manager-69fc866d76-q4g76\" (UID: \"7de1a033-ad8c-4d43-aba4-a77f24024876\") " pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.519154 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.519109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-882zs\" (UniqueName: \"kubernetes.io/projected/5fe5b788-7938-48a2-a24d-48ba9d3a3dc2-kube-api-access-882zs\") pod \"llmisvc-controller-manager-864bfd7bc9-jvdrc\" (UID: \"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.519154 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.519132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmxl\" (UniqueName: \"kubernetes.io/projected/7de1a033-ad8c-4d43-aba4-a77f24024876-kube-api-access-4kmxl\") pod \"kserve-controller-manager-69fc866d76-q4g76\" (UID: \"7de1a033-ad8c-4d43-aba4-a77f24024876\") " pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.519443 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.519248 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe5b788-7938-48a2-a24d-48ba9d3a3dc2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jvdrc\" (UID: \"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.521788 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.521761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7de1a033-ad8c-4d43-aba4-a77f24024876-cert\") pod \"kserve-controller-manager-69fc866d76-q4g76\" (UID: \"7de1a033-ad8c-4d43-aba4-a77f24024876\") " pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.521888 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.521819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe5b788-7938-48a2-a24d-48ba9d3a3dc2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jvdrc\" (UID: \"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.534218 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.534190 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-882zs\" (UniqueName: \"kubernetes.io/projected/5fe5b788-7938-48a2-a24d-48ba9d3a3dc2-kube-api-access-882zs\") pod \"llmisvc-controller-manager-864bfd7bc9-jvdrc\" (UID: \"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.539138 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.539111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmxl\" (UniqueName: \"kubernetes.io/projected/7de1a033-ad8c-4d43-aba4-a77f24024876-kube-api-access-4kmxl\") pod \"kserve-controller-manager-69fc866d76-q4g76\" (UID: \"7de1a033-ad8c-4d43-aba4-a77f24024876\") " pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.568870 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.568840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:28.576144 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.576121 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:28.728852 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.728818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-q4g76"] Jun 11 23:16:28.732678 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:28.732542 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de1a033_ad8c_4d43_aba4_a77f24024876.slice/crio-3aedeb00cae401affb93dcbf702994999c754c9c3fd792ecc101d1704c947767 WatchSource:0}: Error finding container 3aedeb00cae401affb93dcbf702994999c754c9c3fd792ecc101d1704c947767: Status 404 returned error can't find the container with id 3aedeb00cae401affb93dcbf702994999c754c9c3fd792ecc101d1704c947767 Jun 11 23:16:28.753706 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.753554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc"] Jun 11 23:16:28.756129 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:28.756102 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5fe5b788_7938_48a2_a24d_48ba9d3a3dc2.slice/crio-b48a7dc07c4cb8972db70649f4e07996764f620c6b0fc953462af81bd46b5a48 WatchSource:0}: Error finding container b48a7dc07c4cb8972db70649f4e07996764f620c6b0fc953462af81bd46b5a48: Status 404 returned error can't find the container with id b48a7dc07c4cb8972db70649f4e07996764f620c6b0fc953462af81bd46b5a48 Jun 11 23:16:28.880591 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.880522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" event={"ID":"7de1a033-ad8c-4d43-aba4-a77f24024876","Type":"ContainerStarted","Data":"3aedeb00cae401affb93dcbf702994999c754c9c3fd792ecc101d1704c947767"} Jun 11 23:16:28.881608 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:28.881584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" event={"ID":"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2","Type":"ContainerStarted","Data":"b48a7dc07c4cb8972db70649f4e07996764f620c6b0fc953462af81bd46b5a48"} Jun 11 23:16:31.896299 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:31.896258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" event={"ID":"7de1a033-ad8c-4d43-aba4-a77f24024876","Type":"ContainerStarted","Data":"5e6e6019084295af6b4554cb91d85b7f0e0019fb4659f58357546b4d2f02f1bc"} Jun 11 23:16:31.896787 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:31.896438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:16:31.948945 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:31.948887 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" podStartSLOduration=1.263997035 podStartE2EDuration="3.948868345s" totalImagesPullingTime="2.68487131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:31.946435402 +0000 UTC m=+390.032361987" watchObservedRunningTime="2026-06-11 23:16:31.948868345 +0000 UTC m=+390.034794948" Jun 11 23:16:32.900848 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:32.900804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" event={"ID":"5fe5b788-7938-48a2-a24d-48ba9d3a3dc2","Type":"ContainerStarted","Data":"98baf79529851a10b663728db0104d226801a53d1f78e5aa6cedfc8276e54fef"} Jun 11 23:16:32.901268 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:32.901110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:16:32.933131 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:32.933062 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" podStartSLOduration=1.5382943839999998 podStartE2EDuration="4.933039574s" totalImagesPullingTime="3.39474519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:32.928155397 +0000 UTC m=+391.014081958" watchObservedRunningTime="2026-06-11 23:16:32.933039574 +0000 UTC m=+391.018966136" Jun 11 23:16:34.869469 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:34.869439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-6wsnc" Jun 11 23:16:34.886046 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:34.886013 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-ftq6j" Jun 11 23:16:35.872506 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.872466 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9skvb"] Jun 11 23:16:35.875746 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.875728 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:35.876388 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.876365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjf5r\" (UniqueName: \"kubernetes.io/projected/148bfe8f-ed72-4b01-a003-38f91cc32a11-kube-api-access-sjf5r\") pod \"servicemesh-operator3-57f65f65fb-9skvb\" (UID: \"148bfe8f-ed72-4b01-a003-38f91cc32a11\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:35.876501 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.876402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/148bfe8f-ed72-4b01-a003-38f91cc32a11-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9skvb\" (UID: \"148bfe8f-ed72-4b01-a003-38f91cc32a11\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:35.878146 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.878121 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 23:16:35.878248 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.878156 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pk7ks\"" Jun 11 23:16:35.878248 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.878193 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 23:16:35.893145 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.893115 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9skvb"] Jun 11 23:16:35.977619 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.977552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjf5r\" (UniqueName: \"kubernetes.io/projected/148bfe8f-ed72-4b01-a003-38f91cc32a11-kube-api-access-sjf5r\") pod \"servicemesh-operator3-57f65f65fb-9skvb\" (UID: \"148bfe8f-ed72-4b01-a003-38f91cc32a11\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:35.977774 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.977637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/148bfe8f-ed72-4b01-a003-38f91cc32a11-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9skvb\" (UID: \"148bfe8f-ed72-4b01-a003-38f91cc32a11\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:35.980263 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.980239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/148bfe8f-ed72-4b01-a003-38f91cc32a11-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9skvb\" (UID: \"148bfe8f-ed72-4b01-a003-38f91cc32a11\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:35.994404 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:35.994367 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjf5r\" (UniqueName: \"kubernetes.io/projected/148bfe8f-ed72-4b01-a003-38f91cc32a11-kube-api-access-sjf5r\") pod \"servicemesh-operator3-57f65f65fb-9skvb\" (UID: \"148bfe8f-ed72-4b01-a003-38f91cc32a11\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:36.185599 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:36.185477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:36.347468 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:36.347444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9skvb"] Jun 11 23:16:36.349539 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:36.349504 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148bfe8f_ed72_4b01_a003_38f91cc32a11.slice/crio-eb8683319c0f3dc2523f60fc8cc0c3f89a032e7a54d9db74be6ba9065043eb73 WatchSource:0}: Error finding container eb8683319c0f3dc2523f60fc8cc0c3f89a032e7a54d9db74be6ba9065043eb73: Status 404 returned error can't find the container with id eb8683319c0f3dc2523f60fc8cc0c3f89a032e7a54d9db74be6ba9065043eb73 Jun 11 23:16:36.920419 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:36.920380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" event={"ID":"148bfe8f-ed72-4b01-a003-38f91cc32a11","Type":"ContainerStarted","Data":"eb8683319c0f3dc2523f60fc8cc0c3f89a032e7a54d9db74be6ba9065043eb73"} Jun 11 23:16:39.936580 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:39.936524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" event={"ID":"148bfe8f-ed72-4b01-a003-38f91cc32a11","Type":"ContainerStarted","Data":"89e33b7a2fcedfccf3bf0d00bc1366b1dd4f787cfaf99cc23e9162c38fa6e772"} Jun 11 23:16:39.937061 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:39.936709 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:39.957919 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:39.957864 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" podStartSLOduration=2.229650166 podStartE2EDuration="4.957850215s" totalImagesPullingTime="2.728200049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:39.95649127 +0000 UTC m=+398.042417850" watchObservedRunningTime="2026-06-11 23:16:39.957850215 +0000 UTC m=+398.043776777" Jun 11 23:16:44.035432 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.035397 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx"] Jun 11 23:16:44.038675 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.038659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.041011 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.040964 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 23:16:44.041131 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.040967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 23:16:44.041131 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.040970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tvmg8\"" Jun 11 23:16:44.041421 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.041406 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 23:16:44.041514 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.041410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:16:44.058122 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.058095 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx"] Jun 11 23:16:44.135099 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.135259 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.135259 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.135259 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.135259 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x5hz\" (UniqueName: \"kubernetes.io/projected/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-kube-api-access-2x5hz\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.135259 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.135423 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.135280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236396 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x5hz\" (UniqueName: \"kubernetes.io/projected/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-kube-api-access-2x5hz\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.236864 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.236619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.237251 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.237218 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.239195 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.239161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.239376 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.239356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.239515 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.239498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.239640 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.239620 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.245342 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.245306 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x5hz\" (UniqueName: \"kubernetes.io/projected/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-kube-api-access-2x5hz\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.246116 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.246101 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gtmjx\" (UID: \"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.349105 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.348984 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:44.490654 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.490631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx"] Jun 11 23:16:44.493194 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:44.493151 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ae3fd8_a277_401b_b1a1_d33fe1f2b1f0.slice/crio-d933ba95d80ca5b0b8c4cb85eced7ff029059cd8b6302ec75657a6b345128649 WatchSource:0}: Error finding container d933ba95d80ca5b0b8c4cb85eced7ff029059cd8b6302ec75657a6b345128649: Status 404 returned error can't find the container with id d933ba95d80ca5b0b8c4cb85eced7ff029059cd8b6302ec75657a6b345128649 Jun 11 23:16:44.964571 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:44.964520 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" event={"ID":"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0","Type":"ContainerStarted","Data":"d933ba95d80ca5b0b8c4cb85eced7ff029059cd8b6302ec75657a6b345128649"} Jun 11 23:16:47.097692 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:47.097631 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:16:47.097979 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:47.097733 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:16:47.982989 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:47.982956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" event={"ID":"63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0","Type":"ContainerStarted","Data":"49bb9142dac256bfa7e153f13f8742241bb187f5dcc3f11cba23d8803a8a5758"} Jun 11 23:16:47.983224 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:47.983016 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:48.012275 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:48.012213 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" podStartSLOduration=1.4102171000000001 podStartE2EDuration="4.012191177s" totalImagesPullingTime="2.601974077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:48.009508555 +0000 UTC m=+406.095435117" watchObservedRunningTime="2026-06-11 23:16:48.012191177 +0000 UTC m=+406.098117740" Jun 11 23:16:48.992786 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:48.992755 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gtmjx" Jun 11 23:16:50.944404 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:50.944367 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9skvb" Jun 11 23:16:52.642911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.642877 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d79f9cfb6-8bp49"] Jun 11 23:16:52.648012 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.647995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.651385 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.651362 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 23:16:52.651508 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.651446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7c5bv\"" Jun 11 23:16:52.660403 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.660380 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d79f9cfb6-8bp49"] Jun 11 23:16:52.708286 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.708249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6kgx\" (UniqueName: \"kubernetes.io/projected/84b058a0-6345-408a-ae2f-d750bb7dab38-kube-api-access-g6kgx\") pod \"dashboard-redirect-6d79f9cfb6-8bp49\" (UID: \"84b058a0-6345-408a-ae2f-d750bb7dab38\") " pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.708286 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.708288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/84b058a0-6345-408a-ae2f-d750bb7dab38-redirect-config\") pod \"dashboard-redirect-6d79f9cfb6-8bp49\" (UID: \"84b058a0-6345-408a-ae2f-d750bb7dab38\") " pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.808906 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.808871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6kgx\" (UniqueName: \"kubernetes.io/projected/84b058a0-6345-408a-ae2f-d750bb7dab38-kube-api-access-g6kgx\") pod \"dashboard-redirect-6d79f9cfb6-8bp49\" (UID: \"84b058a0-6345-408a-ae2f-d750bb7dab38\") " pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.808906 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.808910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/84b058a0-6345-408a-ae2f-d750bb7dab38-redirect-config\") pod \"dashboard-redirect-6d79f9cfb6-8bp49\" (UID: \"84b058a0-6345-408a-ae2f-d750bb7dab38\") " pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.809600 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.809552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/84b058a0-6345-408a-ae2f-d750bb7dab38-redirect-config\") pod \"dashboard-redirect-6d79f9cfb6-8bp49\" (UID: \"84b058a0-6345-408a-ae2f-d750bb7dab38\") " pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.836871 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.836840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6kgx\" (UniqueName: \"kubernetes.io/projected/84b058a0-6345-408a-ae2f-d750bb7dab38-kube-api-access-g6kgx\") pod \"dashboard-redirect-6d79f9cfb6-8bp49\" (UID: \"84b058a0-6345-408a-ae2f-d750bb7dab38\") " pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:52.958340 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:52.958263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" Jun 11 23:16:53.107476 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:53.107447 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d79f9cfb6-8bp49"] Jun 11 23:16:53.110215 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:16:53.110188 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b058a0_6345_408a_ae2f_d750bb7dab38.slice/crio-0cd1ad7e2ba4308e0dca9ab7c1267433f96002b89d90ffb63976053f340d57af WatchSource:0}: Error finding container 0cd1ad7e2ba4308e0dca9ab7c1267433f96002b89d90ffb63976053f340d57af: Status 404 returned error can't find the container with id 0cd1ad7e2ba4308e0dca9ab7c1267433f96002b89d90ffb63976053f340d57af Jun 11 23:16:54.011918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:54.011869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" event={"ID":"84b058a0-6345-408a-ae2f-d750bb7dab38","Type":"ContainerStarted","Data":"0cd1ad7e2ba4308e0dca9ab7c1267433f96002b89d90ffb63976053f340d57af"} Jun 11 23:16:56.021278 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:56.021243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" event={"ID":"84b058a0-6345-408a-ae2f-d750bb7dab38","Type":"ContainerStarted","Data":"80e4a588a8895f466f1f48bea8003fcb67f93b5567e4349b425879687e318f8c"} Jun 11 23:16:56.036765 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:16:56.036708 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d79f9cfb6-8bp49" podStartSLOduration=1.558615778 podStartE2EDuration="4.036692964s" totalImagesPullingTime="2.478077186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:56.036258696 +0000 UTC m=+414.122185259" watchObservedRunningTime="2026-06-11 23:16:56.036692964 +0000 UTC m=+414.122619525" Jun 11 23:17:02.906258 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:02.906227 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-q4g76" Jun 11 23:17:03.907660 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:03.907631 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jvdrc" Jun 11 23:17:54.016414 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.016373 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx"] Jun 11 23:17:54.020028 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.019971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:17:54.022553 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.022530 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:17:54.023000 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.022977 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 23:17:54.023067 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.022989 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pbkpm\"" Jun 11 23:17:54.023067 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.023024 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:17:54.031051 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.031026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx"] Jun 11 23:17:54.112016 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.111974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm4jj\" (UniqueName: \"kubernetes.io/projected/a67ab12c-a19e-4bdb-8a67-3a251dd084fa-kube-api-access-qm4jj\") pod \"dns-operator-controller-manager-864dd78c4c-lgspx\" (UID: \"a67ab12c-a19e-4bdb-8a67-3a251dd084fa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:17:54.213194 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.213150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm4jj\" (UniqueName: \"kubernetes.io/projected/a67ab12c-a19e-4bdb-8a67-3a251dd084fa-kube-api-access-qm4jj\") pod \"dns-operator-controller-manager-864dd78c4c-lgspx\" (UID: \"a67ab12c-a19e-4bdb-8a67-3a251dd084fa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:17:54.225713 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.225680 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm4jj\" (UniqueName: \"kubernetes.io/projected/a67ab12c-a19e-4bdb-8a67-3a251dd084fa-kube-api-access-qm4jj\") pod \"dns-operator-controller-manager-864dd78c4c-lgspx\" (UID: \"a67ab12c-a19e-4bdb-8a67-3a251dd084fa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:17:54.330483 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.330388 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:17:54.477930 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:54.477907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx"] Jun 11 23:17:54.480367 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:17:54.480338 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67ab12c_a19e_4bdb_8a67_3a251dd084fa.slice/crio-3d6963f852b828bc20b13898841eff4b75da8abb75a0a2ec0d1b7d8e7c1a2138 WatchSource:0}: Error finding container 3d6963f852b828bc20b13898841eff4b75da8abb75a0a2ec0d1b7d8e7c1a2138: Status 404 returned error can't find the container with id 3d6963f852b828bc20b13898841eff4b75da8abb75a0a2ec0d1b7d8e7c1a2138 Jun 11 23:17:55.287781 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:55.287725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" event={"ID":"a67ab12c-a19e-4bdb-8a67-3a251dd084fa","Type":"ContainerStarted","Data":"3d6963f852b828bc20b13898841eff4b75da8abb75a0a2ec0d1b7d8e7c1a2138"} Jun 11 23:17:57.298894 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:57.298861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" event={"ID":"a67ab12c-a19e-4bdb-8a67-3a251dd084fa","Type":"ContainerStarted","Data":"691d61b46a35cacd6095eb62f61fbf8f833a22d44573db9b6a2f3f8515322d69"} Jun 11 23:17:57.299305 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:57.299090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:17:57.315333 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:17:57.315279 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" podStartSLOduration=2.447312082 podStartE2EDuration="4.315261745s" totalImagesPullingTime="1.867949663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:57.314971072 +0000 UTC m=+475.400897635" watchObservedRunningTime="2026-06-11 23:17:57.315261745 +0000 UTC m=+475.401188308" Jun 11 23:18:00.149456 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.149419 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv"] Jun 11 23:18:00.152762 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.152743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:00.155808 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.155791 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f4ckx\"" Jun 11 23:18:00.162827 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.162803 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv"] Jun 11 23:18:00.266082 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.266044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxddc\" (UniqueName: \"kubernetes.io/projected/9c7c7675-9b5b-4897-943f-36713473d762-kube-api-access-cxddc\") pod \"limitador-operator-controller-manager-859d7b78bd-9vhwv\" (UID: \"9c7c7675-9b5b-4897-943f-36713473d762\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:00.367276 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.367236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxddc\" (UniqueName: \"kubernetes.io/projected/9c7c7675-9b5b-4897-943f-36713473d762-kube-api-access-cxddc\") pod \"limitador-operator-controller-manager-859d7b78bd-9vhwv\" (UID: \"9c7c7675-9b5b-4897-943f-36713473d762\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:00.376314 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.376277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxddc\" (UniqueName: \"kubernetes.io/projected/9c7c7675-9b5b-4897-943f-36713473d762-kube-api-access-cxddc\") pod \"limitador-operator-controller-manager-859d7b78bd-9vhwv\" (UID: \"9c7c7675-9b5b-4897-943f-36713473d762\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:00.463698 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.463597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:00.607974 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:00.607949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv"] Jun 11 23:18:00.610023 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:18:00.609995 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7c7675_9b5b_4897_943f_36713473d762.slice/crio-3fdaf06c63bbabc49afd88ae0bd1ff4a3dd7ec8a5fb3c2c9605b86af25c44655 WatchSource:0}: Error finding container 3fdaf06c63bbabc49afd88ae0bd1ff4a3dd7ec8a5fb3c2c9605b86af25c44655: Status 404 returned error can't find the container with id 3fdaf06c63bbabc49afd88ae0bd1ff4a3dd7ec8a5fb3c2c9605b86af25c44655 Jun 11 23:18:01.318337 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:01.318296 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" event={"ID":"9c7c7675-9b5b-4897-943f-36713473d762","Type":"ContainerStarted","Data":"3fdaf06c63bbabc49afd88ae0bd1ff4a3dd7ec8a5fb3c2c9605b86af25c44655"} Jun 11 23:18:03.328434 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:03.328396 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" event={"ID":"9c7c7675-9b5b-4897-943f-36713473d762","Type":"ContainerStarted","Data":"7629a76a0c7c6859cddeafb4458d26e8cc9e4e73440b9eb8ad332327f4bc964c"} Jun 11 23:18:03.328861 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:03.328526 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:03.347648 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:03.347596 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" podStartSLOduration=1.342552746 podStartE2EDuration="3.347581031s" totalImagesPullingTime="2.005028285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:03.345131328 +0000 UTC m=+481.431057892" watchObservedRunningTime="2026-06-11 23:18:03.347581031 +0000 UTC m=+481.433507590" Jun 11 23:18:08.305528 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:08.305491 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lgspx" Jun 11 23:18:14.335838 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:14.335808 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:17.349249 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.349210 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm"] Jun 11 23:18:17.352862 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.352835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.356698 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.356679 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7ddwd\"" Jun 11 23:18:17.369630 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.369604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm"] Jun 11 23:18:17.526375 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.526338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d80db53-0dae-477d-80f5-01d262e24195-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.526375 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.526388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpm9\" (UniqueName: \"kubernetes.io/projected/1d80db53-0dae-477d-80f5-01d262e24195-kube-api-access-hfpm9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.627163 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.627122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d80db53-0dae-477d-80f5-01d262e24195-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.627346 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.627182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpm9\" (UniqueName: \"kubernetes.io/projected/1d80db53-0dae-477d-80f5-01d262e24195-kube-api-access-hfpm9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.627517 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.627498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d80db53-0dae-477d-80f5-01d262e24195-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.648516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.648484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpm9\" (UniqueName: \"kubernetes.io/projected/1d80db53-0dae-477d-80f5-01d262e24195-kube-api-access-hfpm9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.663277 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.663250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:17.826109 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:17.826072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm"] Jun 11 23:18:17.832063 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:18:17.832035 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d80db53_0dae_477d_80f5_01d262e24195.slice/crio-85d3bd1ecf211d095163a673fba112ded5658a3d1fe80ec310c918e8b8d605e2 WatchSource:0}: Error finding container 85d3bd1ecf211d095163a673fba112ded5658a3d1fe80ec310c918e8b8d605e2: Status 404 returned error can't find the container with id 85d3bd1ecf211d095163a673fba112ded5658a3d1fe80ec310c918e8b8d605e2 Jun 11 23:18:18.116102 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.116066 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm"] Jun 11 23:18:18.120675 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.120646 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm"] Jun 11 23:18:18.168524 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.168492 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv"] Jun 11 23:18:18.168755 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.168723 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" podUID="9c7c7675-9b5b-4897-943f-36713473d762" containerName="manager" containerID="cri-o://7629a76a0c7c6859cddeafb4458d26e8cc9e4e73440b9eb8ad332327f4bc964c" gracePeriod=2 Jun 11 23:18:18.184834 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.184801 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv"] Jun 11 23:18:18.215941 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:18.215851 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c7c7675-9b5b-4897-943f-36713473d762\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-9vhwv\": pods \"limitador-operator-controller-manager-859d7b78bd-9vhwv\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:18.218282 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.218244 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g"] Jun 11 23:18:18.218788 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.218767 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7c7675-9b5b-4897-943f-36713473d762" containerName="manager" Jun 11 23:18:18.218851 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.218792 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7c7675-9b5b-4897-943f-36713473d762" containerName="manager" Jun 11 23:18:18.218914 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.218902 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c7c7675-9b5b-4897-943f-36713473d762" containerName="manager" Jun 11 23:18:18.221980 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.221957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:18.226817 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.226787 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g"] Jun 11 23:18:18.244941 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:18.244897 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vhwv\" is forbidden: User \"system:node:ip-10-0-143-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-190.ec2.internal' and this object" podUID="9c7c7675-9b5b-4897-943f-36713473d762" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:18.334588 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.334537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9tv\" (UniqueName: \"kubernetes.io/projected/50651648-79db-4641-a2df-ec7810ae062a-kube-api-access-bw9tv\") pod \"limitador-operator-controller-manager-859d7b78bd-mnz8g\" (UID: \"50651648-79db-4641-a2df-ec7810ae062a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:18.402113 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.402033 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c7c7675-9b5b-4897-943f-36713473d762" containerID="7629a76a0c7c6859cddeafb4458d26e8cc9e4e73440b9eb8ad332327f4bc964c" exitCode=0 Jun 11 23:18:18.436141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.436104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9tv\" (UniqueName: \"kubernetes.io/projected/50651648-79db-4641-a2df-ec7810ae062a-kube-api-access-bw9tv\") pod \"limitador-operator-controller-manager-859d7b78bd-mnz8g\" (UID: \"50651648-79db-4641-a2df-ec7810ae062a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:18.452157 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.452122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9tv\" (UniqueName: \"kubernetes.io/projected/50651648-79db-4641-a2df-ec7810ae062a-kube-api-access-bw9tv\") pod \"limitador-operator-controller-manager-859d7b78bd-mnz8g\" (UID: \"50651648-79db-4641-a2df-ec7810ae062a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:18.509487 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.509452 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:18.543471 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.543436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:18.637889 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.637855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxddc\" (UniqueName: \"kubernetes.io/projected/9c7c7675-9b5b-4897-943f-36713473d762-kube-api-access-cxddc\") pod \"9c7c7675-9b5b-4897-943f-36713473d762\" (UID: \"9c7c7675-9b5b-4897-943f-36713473d762\") " Jun 11 23:18:18.640732 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.640704 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7c7675-9b5b-4897-943f-36713473d762-kube-api-access-cxddc" (OuterVolumeSpecName: "kube-api-access-cxddc") pod "9c7c7675-9b5b-4897-943f-36713473d762" (UID: "9c7c7675-9b5b-4897-943f-36713473d762"). InnerVolumeSpecName "kube-api-access-cxddc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:18.739414 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.739370 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxddc\" (UniqueName: \"kubernetes.io/projected/9c7c7675-9b5b-4897-943f-36713473d762-kube-api-access-cxddc\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:18:18.868602 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:18.868548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g"] Jun 11 23:18:18.871261 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:18:18.871226 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50651648_79db_4641_a2df_ec7810ae062a.slice/crio-cde6ab3105f68da3401516a16660bbb0ab492c20e8fcd85f5b4be9f9de68f028 WatchSource:0}: Error finding container cde6ab3105f68da3401516a16660bbb0ab492c20e8fcd85f5b4be9f9de68f028: Status 404 returned error can't find the container with id cde6ab3105f68da3401516a16660bbb0ab492c20e8fcd85f5b4be9f9de68f028 Jun 11 23:18:19.411688 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:19.411635 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vhwv" Jun 11 23:18:19.412088 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:19.411687 2581 scope.go:117] "RemoveContainer" containerID="7629a76a0c7c6859cddeafb4458d26e8cc9e4e73440b9eb8ad332327f4bc964c" Jun 11 23:18:19.414056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:19.414026 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" event={"ID":"50651648-79db-4641-a2df-ec7810ae062a","Type":"ContainerStarted","Data":"934ea648fc7f0c84b3df6b1c39db2b178eb396191102fd43a082862bcb5e21c8"} Jun 11 23:18:19.414178 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:19.414080 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" event={"ID":"50651648-79db-4641-a2df-ec7810ae062a","Type":"ContainerStarted","Data":"cde6ab3105f68da3401516a16660bbb0ab492c20e8fcd85f5b4be9f9de68f028"} Jun 11 23:18:19.414178 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:19.414156 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:19.435150 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:19.435099 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" podStartSLOduration=1.43507865 podStartE2EDuration="1.43507865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:19.433629696 +0000 UTC m=+497.519556279" watchObservedRunningTime="2026-06-11 23:18:19.43507865 +0000 UTC m=+497.521005213" Jun 11 23:18:20.411048 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:20.411001 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7c7675-9b5b-4897-943f-36713473d762" path="/var/lib/kubelet/pods/9c7c7675-9b5b-4897-943f-36713473d762/volumes" Jun 11 23:18:22.433200 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.433156 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" podUID="1d80db53-0dae-477d-80f5-01d262e24195" containerName="manager" containerID="cri-o://116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5" gracePeriod=2 Jun 11 23:18:22.435149 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:22.435120 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" is forbidden: User \"system:node:ip-10-0-143-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-190.ec2.internal' and this object" podUID="1d80db53-0dae-477d-80f5-01d262e24195" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:22.671748 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.671723 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:22.674116 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:22.674086 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" is forbidden: User \"system:node:ip-10-0-143-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-190.ec2.internal' and this object" podUID="1d80db53-0dae-477d-80f5-01d262e24195" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:22.773065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.772978 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d80db53-0dae-477d-80f5-01d262e24195-extensions-socket-volume\") pod \"1d80db53-0dae-477d-80f5-01d262e24195\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " Jun 11 23:18:22.773065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.773030 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfpm9\" (UniqueName: \"kubernetes.io/projected/1d80db53-0dae-477d-80f5-01d262e24195-kube-api-access-hfpm9\") pod \"1d80db53-0dae-477d-80f5-01d262e24195\" (UID: \"1d80db53-0dae-477d-80f5-01d262e24195\") " Jun 11 23:18:22.773283 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.773259 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d80db53-0dae-477d-80f5-01d262e24195-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1d80db53-0dae-477d-80f5-01d262e24195" (UID: "1d80db53-0dae-477d-80f5-01d262e24195"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:22.775311 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.775288 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d80db53-0dae-477d-80f5-01d262e24195-kube-api-access-hfpm9" (OuterVolumeSpecName: "kube-api-access-hfpm9") pod "1d80db53-0dae-477d-80f5-01d262e24195" (UID: "1d80db53-0dae-477d-80f5-01d262e24195"). InnerVolumeSpecName "kube-api-access-hfpm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:22.874297 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.874258 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d80db53-0dae-477d-80f5-01d262e24195-extensions-socket-volume\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:18:22.874297 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:22.874291 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfpm9\" (UniqueName: \"kubernetes.io/projected/1d80db53-0dae-477d-80f5-01d262e24195-kube-api-access-hfpm9\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:18:23.439593 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:23.439543 2581 generic.go:356] "Generic (PLEG): container finished" podID="1d80db53-0dae-477d-80f5-01d262e24195" containerID="116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5" exitCode=2 Jun 11 23:18:23.439593 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:23.439594 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:23.439593 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:23.439610 2581 scope.go:117] "RemoveContainer" containerID="116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5" Jun 11 23:18:23.441571 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:23.441532 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" is forbidden: User \"system:node:ip-10-0-143-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-190.ec2.internal' and this object" podUID="1d80db53-0dae-477d-80f5-01d262e24195" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:23.448196 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:23.448178 2581 scope.go:117] "RemoveContainer" containerID="116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5" Jun 11 23:18:23.448454 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:23.448436 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5\": container with ID starting with 116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5 not found: ID does not exist" containerID="116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5" Jun 11 23:18:23.448512 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:23.448462 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5"} err="failed to get container status \"116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5\": rpc error: code = NotFound desc = could not find container \"116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5\": container with ID starting with 116f3cb2423efd9f30dac7a9d11960297fad403a58af8e126fc7fe54745ca4b5 not found: ID does not exist" Jun 11 23:18:23.449378 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:18:23.449352 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ss5xm\" is forbidden: User \"system:node:ip-10-0-143-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-190.ec2.internal' and this object" podUID="1d80db53-0dae-477d-80f5-01d262e24195" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss5xm" Jun 11 23:18:24.410012 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:24.409978 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d80db53-0dae-477d-80f5-01d262e24195" path="/var/lib/kubelet/pods/1d80db53-0dae-477d-80f5-01d262e24195/volumes" Jun 11 23:18:30.423955 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:30.423921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mnz8g" Jun 11 23:18:46.741604 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.741546 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9"] Jun 11 23:18:46.742056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.741935 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d80db53-0dae-477d-80f5-01d262e24195" containerName="manager" Jun 11 23:18:46.742056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.741948 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d80db53-0dae-477d-80f5-01d262e24195" containerName="manager" Jun 11 23:18:46.742056 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.742010 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d80db53-0dae-477d-80f5-01d262e24195" containerName="manager" Jun 11 23:18:46.743933 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.743915 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:46.747053 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.747037 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7ddwd\"" Jun 11 23:18:46.758976 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.758948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9"] Jun 11 23:18:46.849399 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.849360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/374be118-a5dd-4d50-b1c1-52232c236b67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s54h9\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:46.849611 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.849473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj8m6\" (UniqueName: \"kubernetes.io/projected/374be118-a5dd-4d50-b1c1-52232c236b67-kube-api-access-lj8m6\") pod \"kuadrant-operator-controller-manager-86878c769f-s54h9\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:46.950199 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.950161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj8m6\" (UniqueName: \"kubernetes.io/projected/374be118-a5dd-4d50-b1c1-52232c236b67-kube-api-access-lj8m6\") pod \"kuadrant-operator-controller-manager-86878c769f-s54h9\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:46.950344 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.950231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/374be118-a5dd-4d50-b1c1-52232c236b67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s54h9\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:46.950591 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.950548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/374be118-a5dd-4d50-b1c1-52232c236b67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s54h9\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:46.959318 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:46.959291 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj8m6\" (UniqueName: \"kubernetes.io/projected/374be118-a5dd-4d50-b1c1-52232c236b67-kube-api-access-lj8m6\") pod \"kuadrant-operator-controller-manager-86878c769f-s54h9\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:47.053423 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:47.053329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:47.192083 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:47.192053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9"] Jun 11 23:18:47.195653 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:18:47.195624 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374be118_a5dd_4d50_b1c1_52232c236b67.slice/crio-003b850e1e98c0e79233a2fd35a39df85db962d9e266b3b248160dcfbfeaa0ab WatchSource:0}: Error finding container 003b850e1e98c0e79233a2fd35a39df85db962d9e266b3b248160dcfbfeaa0ab: Status 404 returned error can't find the container with id 003b850e1e98c0e79233a2fd35a39df85db962d9e266b3b248160dcfbfeaa0ab Jun 11 23:18:47.554511 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:47.554470 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" event={"ID":"374be118-a5dd-4d50-b1c1-52232c236b67","Type":"ContainerStarted","Data":"22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e"} Jun 11 23:18:47.554738 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:47.554582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" event={"ID":"374be118-a5dd-4d50-b1c1-52232c236b67","Type":"ContainerStarted","Data":"003b850e1e98c0e79233a2fd35a39df85db962d9e266b3b248160dcfbfeaa0ab"} Jun 11 23:18:47.554738 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:47.554693 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:18:47.608478 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:47.608414 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" podStartSLOduration=1.608395206 podStartE2EDuration="1.608395206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:47.607488244 +0000 UTC m=+525.693414832" watchObservedRunningTime="2026-06-11 23:18:47.608395206 +0000 UTC m=+525.694321770" Jun 11 23:18:58.560622 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:18:58.560553 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:20:02.382136 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:02.382109 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:20:02.382580 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:02.382323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:20:36.631986 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.631942 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ffb868df6-m6rgz"] Jun 11 23:20:36.635525 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.635506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:36.637891 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.637867 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:20:36.638016 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.637890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjbtx\"" Jun 11 23:20:36.638016 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.637864 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 23:20:36.648153 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.648127 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffb868df6-m6rgz"] Jun 11 23:20:36.759856 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.759825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwrtb\" (UniqueName: \"kubernetes.io/projected/71421580-8543-4bbf-b113-4ba6b704edda-kube-api-access-rwrtb\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:36.760047 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.759916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:36.799155 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.799122 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65b78f8549-7brfw"] Jun 11 23:20:36.802394 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.802367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:36.813231 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.813201 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65b78f8549-7brfw"] Jun 11 23:20:36.860804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.860772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwrtb\" (UniqueName: \"kubernetes.io/projected/71421580-8543-4bbf-b113-4ba6b704edda-kube-api-access-rwrtb\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:36.860949 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.860858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:36.861006 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:20:36.860954 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 23:20:36.861041 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:20:36.861023 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert podName:71421580-8543-4bbf-b113-4ba6b704edda nodeName:}" failed. No retries permitted until 2026-06-11 23:20:37.361007738 +0000 UTC m=+635.446934278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert") pod "maas-controller-7ffb868df6-m6rgz" (UID: "71421580-8543-4bbf-b113-4ba6b704edda") : secret "maas-controller-webhook-cert" not found Jun 11 23:20:36.869762 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.869729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwrtb\" (UniqueName: \"kubernetes.io/projected/71421580-8543-4bbf-b113-4ba6b704edda-kube-api-access-rwrtb\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:36.962027 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.961936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxv7\" (UniqueName: \"kubernetes.io/projected/77b3be26-3958-49ce-b212-f94caca9d5bf-kube-api-access-xxxv7\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:36.962196 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:36.962038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.062766 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.062730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxv7\" (UniqueName: \"kubernetes.io/projected/77b3be26-3958-49ce-b212-f94caca9d5bf-kube-api-access-xxxv7\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.062975 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.062820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.062975 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:20:37.062911 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 23:20:37.062975 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:20:37.062967 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert podName:77b3be26-3958-49ce-b212-f94caca9d5bf nodeName:}" failed. No retries permitted until 2026-06-11 23:20:37.562951401 +0000 UTC m=+635.648877962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert") pod "maas-controller-65b78f8549-7brfw" (UID: "77b3be26-3958-49ce-b212-f94caca9d5bf") : secret "maas-controller-webhook-cert" not found Jun 11 23:20:37.071839 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.071811 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxv7\" (UniqueName: \"kubernetes.io/projected/77b3be26-3958-49ce-b212-f94caca9d5bf-kube-api-access-xxxv7\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.365930 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.365894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:37.368439 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.368415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert\") pod \"maas-controller-7ffb868df6-m6rgz\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:37.547382 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.547341 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:37.567734 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.567705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.570680 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.570649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert\") pod \"maas-controller-65b78f8549-7brfw\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.678918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.678888 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffb868df6-m6rgz"] Jun 11 23:20:37.681670 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:20:37.681639 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71421580_8543_4bbf_b113_4ba6b704edda.slice/crio-d356feafe425246cde2db1f356a9bf46e76fbe05b139b0166ddcfeb2204a606c WatchSource:0}: Error finding container d356feafe425246cde2db1f356a9bf46e76fbe05b139b0166ddcfeb2204a606c: Status 404 returned error can't find the container with id d356feafe425246cde2db1f356a9bf46e76fbe05b139b0166ddcfeb2204a606c Jun 11 23:20:37.720454 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.720423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:37.858156 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:37.858103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65b78f8549-7brfw"] Jun 11 23:20:37.860344 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:20:37.860315 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b3be26_3958_49ce_b212_f94caca9d5bf.slice/crio-8a183ceacb94633bf5e2f3062a7dfe39d2b1e0bc8cdb919229d0952df50b3174 WatchSource:0}: Error finding container 8a183ceacb94633bf5e2f3062a7dfe39d2b1e0bc8cdb919229d0952df50b3174: Status 404 returned error can't find the container with id 8a183ceacb94633bf5e2f3062a7dfe39d2b1e0bc8cdb919229d0952df50b3174 Jun 11 23:20:38.029418 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:38.029319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b78f8549-7brfw" event={"ID":"77b3be26-3958-49ce-b212-f94caca9d5bf","Type":"ContainerStarted","Data":"8a183ceacb94633bf5e2f3062a7dfe39d2b1e0bc8cdb919229d0952df50b3174"} Jun 11 23:20:38.030526 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:38.030492 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" event={"ID":"71421580-8543-4bbf-b113-4ba6b704edda","Type":"ContainerStarted","Data":"d356feafe425246cde2db1f356a9bf46e76fbe05b139b0166ddcfeb2204a606c"} Jun 11 23:20:40.041065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:40.040965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" event={"ID":"71421580-8543-4bbf-b113-4ba6b704edda","Type":"ContainerStarted","Data":"93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4"} Jun 11 23:20:40.041065 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:40.041032 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:40.042351 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:40.042326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b78f8549-7brfw" event={"ID":"77b3be26-3958-49ce-b212-f94caca9d5bf","Type":"ContainerStarted","Data":"0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398"} Jun 11 23:20:40.042473 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:40.042447 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:40.059995 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:40.059933 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" podStartSLOduration=1.957497065 podStartE2EDuration="4.059913018s" totalImagesPullingTime="2.102415953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:40.059223582 +0000 UTC m=+638.145150161" watchObservedRunningTime="2026-06-11 23:20:40.059913018 +0000 UTC m=+638.145839580" Jun 11 23:20:40.086646 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:40.086588 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65b78f8549-7brfw" podStartSLOduration=2.158990167 podStartE2EDuration="4.086553205s" totalImagesPullingTime="1.927563038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:40.085818052 +0000 UTC m=+638.171744638" watchObservedRunningTime="2026-06-11 23:20:40.086553205 +0000 UTC m=+638.172479785" Jun 11 23:20:51.053436 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.053405 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:51.055809 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.053485 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:20:51.115778 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.115744 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ffb868df6-m6rgz"] Jun 11 23:20:51.115940 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.115917 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" podUID="71421580-8543-4bbf-b113-4ba6b704edda" containerName="manager" containerID="cri-o://93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4" gracePeriod=30 Jun 11 23:20:51.359966 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.359935 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:51.371716 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.371692 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert\") pod \"71421580-8543-4bbf-b113-4ba6b704edda\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " Jun 11 23:20:51.371839 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.371777 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwrtb\" (UniqueName: \"kubernetes.io/projected/71421580-8543-4bbf-b113-4ba6b704edda-kube-api-access-rwrtb\") pod \"71421580-8543-4bbf-b113-4ba6b704edda\" (UID: \"71421580-8543-4bbf-b113-4ba6b704edda\") " Jun 11 23:20:51.373889 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.373860 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "71421580-8543-4bbf-b113-4ba6b704edda" (UID: "71421580-8543-4bbf-b113-4ba6b704edda"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:20:51.374011 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.373985 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71421580-8543-4bbf-b113-4ba6b704edda-kube-api-access-rwrtb" (OuterVolumeSpecName: "kube-api-access-rwrtb") pod "71421580-8543-4bbf-b113-4ba6b704edda" (UID: "71421580-8543-4bbf-b113-4ba6b704edda"). InnerVolumeSpecName "kube-api-access-rwrtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:51.472516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.472481 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71421580-8543-4bbf-b113-4ba6b704edda-webhook-cert\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:20:51.472516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:51.472513 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwrtb\" (UniqueName: \"kubernetes.io/projected/71421580-8543-4bbf-b113-4ba6b704edda-kube-api-access-rwrtb\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:20:52.104139 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.104098 2581 generic.go:356] "Generic (PLEG): container finished" podID="71421580-8543-4bbf-b113-4ba6b704edda" containerID="93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4" exitCode=0 Jun 11 23:20:52.104139 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.104141 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" event={"ID":"71421580-8543-4bbf-b113-4ba6b704edda","Type":"ContainerDied","Data":"93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4"} Jun 11 23:20:52.104691 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.104147 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" Jun 11 23:20:52.104691 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.104195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffb868df6-m6rgz" event={"ID":"71421580-8543-4bbf-b113-4ba6b704edda","Type":"ContainerDied","Data":"d356feafe425246cde2db1f356a9bf46e76fbe05b139b0166ddcfeb2204a606c"} Jun 11 23:20:52.104691 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.104219 2581 scope.go:117] "RemoveContainer" containerID="93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4" Jun 11 23:20:52.112753 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.112735 2581 scope.go:117] "RemoveContainer" containerID="93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4" Jun 11 23:20:52.113036 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:20:52.113017 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4\": container with ID starting with 93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4 not found: ID does not exist" containerID="93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4" Jun 11 23:20:52.113082 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.113046 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4"} err="failed to get container status \"93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4\": rpc error: code = NotFound desc = could not find container \"93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4\": container with ID starting with 93d6ed40a72174038a484fc7c4ec7e22c0d0643303ee04d6ff31ee015e8d67a4 not found: ID does not exist" Jun 11 23:20:52.123542 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.123518 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ffb868df6-m6rgz"] Jun 11 23:20:52.127544 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.127515 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7ffb868df6-m6rgz"] Jun 11 23:20:52.410049 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:20:52.410011 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71421580-8543-4bbf-b113-4ba6b704edda" path="/var/lib/kubelet/pods/71421580-8543-4bbf-b113-4ba6b704edda/volumes" Jun 11 23:21:08.020505 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.020466 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5fd589bf7-z9jrh"] Jun 11 23:21:08.021128 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.020818 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71421580-8543-4bbf-b113-4ba6b704edda" containerName="manager" Jun 11 23:21:08.021128 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.020829 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71421580-8543-4bbf-b113-4ba6b704edda" containerName="manager" Jun 11 23:21:08.021128 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.020890 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71421580-8543-4bbf-b113-4ba6b704edda" containerName="manager" Jun 11 23:21:08.024855 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.024838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.038394 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.038364 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 23:21:08.054743 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.054707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fd589bf7-z9jrh"] Jun 11 23:21:08.111891 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.111849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6945b19e-fef7-407d-aa34-ec4db297f730-maas-api-tls\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.112068 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.111910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xtd7\" (UniqueName: \"kubernetes.io/projected/6945b19e-fef7-407d-aa34-ec4db297f730-kube-api-access-7xtd7\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.112068 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.111946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6945b19e-fef7-407d-aa34-ec4db297f730-openshift-service-ca\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.212847 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.212814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xtd7\" (UniqueName: \"kubernetes.io/projected/6945b19e-fef7-407d-aa34-ec4db297f730-kube-api-access-7xtd7\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.213026 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.212857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6945b19e-fef7-407d-aa34-ec4db297f730-openshift-service-ca\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.213026 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.212909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6945b19e-fef7-407d-aa34-ec4db297f730-maas-api-tls\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.213026 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:21:08.213005 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 23:21:08.213145 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:21:08.213065 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6945b19e-fef7-407d-aa34-ec4db297f730-maas-api-tls podName:6945b19e-fef7-407d-aa34-ec4db297f730 nodeName:}" failed. No retries permitted until 2026-06-11 23:21:08.713050404 +0000 UTC m=+666.798976944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6945b19e-fef7-407d-aa34-ec4db297f730-maas-api-tls") pod "maas-api-5fd589bf7-z9jrh" (UID: "6945b19e-fef7-407d-aa34-ec4db297f730") : secret "maas-api-serving-cert" not found Jun 11 23:21:08.213608 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.213588 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6945b19e-fef7-407d-aa34-ec4db297f730-openshift-service-ca\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.229506 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.229482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xtd7\" (UniqueName: \"kubernetes.io/projected/6945b19e-fef7-407d-aa34-ec4db297f730-kube-api-access-7xtd7\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.717651 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.717609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6945b19e-fef7-407d-aa34-ec4db297f730-maas-api-tls\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.720462 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.720428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6945b19e-fef7-407d-aa34-ec4db297f730-maas-api-tls\") pod \"maas-api-5fd589bf7-z9jrh\" (UID: \"6945b19e-fef7-407d-aa34-ec4db297f730\") " pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:08.738382 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.738350 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-v2xft"] Jun 11 23:21:08.742173 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.742156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:21:08.745707 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.745685 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 23:21:08.745845 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.745722 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lp9xp\"" Jun 11 23:21:08.753157 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.753133 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-v2xft"] Jun 11 23:21:08.818705 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.818671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h5hn\" (UniqueName: \"kubernetes.io/projected/2ce7e59b-1dad-4b89-b0b3-a52708740fc9-kube-api-access-2h5hn\") pod \"payload-processing-699b6cd6c-v2xft\" (UID: \"2ce7e59b-1dad-4b89-b0b3-a52708740fc9\") " pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:21:08.919837 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.919782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h5hn\" (UniqueName: \"kubernetes.io/projected/2ce7e59b-1dad-4b89-b0b3-a52708740fc9-kube-api-access-2h5hn\") pod \"payload-processing-699b6cd6c-v2xft\" (UID: \"2ce7e59b-1dad-4b89-b0b3-a52708740fc9\") " pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:21:08.928496 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.928463 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h5hn\" (UniqueName: \"kubernetes.io/projected/2ce7e59b-1dad-4b89-b0b3-a52708740fc9-kube-api-access-2h5hn\") pod \"payload-processing-699b6cd6c-v2xft\" (UID: \"2ce7e59b-1dad-4b89-b0b3-a52708740fc9\") " pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:21:08.940202 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:08.940177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:09.054911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:09.054876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:21:09.078480 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:09.078189 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fd589bf7-z9jrh"] Jun 11 23:21:09.080914 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:21:09.080883 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6945b19e_fef7_407d_aa34_ec4db297f730.slice/crio-d7a0b90d0fc3edc6d9ae13c90436fce307765343bd0850926785586b767b5f3c WatchSource:0}: Error finding container d7a0b90d0fc3edc6d9ae13c90436fce307765343bd0850926785586b767b5f3c: Status 404 returned error can't find the container with id d7a0b90d0fc3edc6d9ae13c90436fce307765343bd0850926785586b767b5f3c Jun 11 23:21:09.082113 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:09.082093 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:21:09.180455 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:09.180418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fd589bf7-z9jrh" event={"ID":"6945b19e-fef7-407d-aa34-ec4db297f730","Type":"ContainerStarted","Data":"d7a0b90d0fc3edc6d9ae13c90436fce307765343bd0850926785586b767b5f3c"} Jun 11 23:21:09.193216 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:09.193173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-v2xft"] Jun 11 23:21:09.195314 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:21:09.195291 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce7e59b_1dad_4b89_b0b3_a52708740fc9.slice/crio-57be838261d28a42ebfa76c187c570e7ff11576280dcf1dd96db122395ae2c5c WatchSource:0}: Error finding container 57be838261d28a42ebfa76c187c570e7ff11576280dcf1dd96db122395ae2c5c: Status 404 returned error can't find the container with id 57be838261d28a42ebfa76c187c570e7ff11576280dcf1dd96db122395ae2c5c Jun 11 23:21:10.187088 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:10.187048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" event={"ID":"2ce7e59b-1dad-4b89-b0b3-a52708740fc9","Type":"ContainerStarted","Data":"57be838261d28a42ebfa76c187c570e7ff11576280dcf1dd96db122395ae2c5c"} Jun 11 23:21:12.198782 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:12.198747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fd589bf7-z9jrh" event={"ID":"6945b19e-fef7-407d-aa34-ec4db297f730","Type":"ContainerStarted","Data":"acc3a4ab7190493e31da07af1e71cdd29fc2971d255dae287fa6eaf5121177da"} Jun 11 23:21:12.199209 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:12.198870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:12.200508 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:12.200483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" event={"ID":"2ce7e59b-1dad-4b89-b0b3-a52708740fc9","Type":"ContainerStarted","Data":"2fff6659d750ce95526ae941aa69b0584ebb9fa47abd5a273f8ae61a607b5a16"} Jun 11 23:21:12.200666 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:12.200607 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:21:12.214852 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:12.214811 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5fd589bf7-z9jrh" podStartSLOduration=2.559932027 podStartE2EDuration="5.214799091s" totalImagesPullingTime="2.654867064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:21:12.213585478 +0000 UTC m=+670.299512050" watchObservedRunningTime="2026-06-11 23:21:12.214799091 +0000 UTC m=+670.300725663" Jun 11 23:21:12.229030 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:12.228986 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" podStartSLOduration=1.644671923 podStartE2EDuration="4.228969255s" totalImagesPullingTime="2.584297332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:21:12.228229776 +0000 UTC m=+670.314156351" watchObservedRunningTime="2026-06-11 23:21:12.228969255 +0000 UTC m=+670.314895818" Jun 11 23:21:18.210290 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:18.210251 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5fd589bf7-z9jrh" Jun 11 23:21:23.207480 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:21:23.207442 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-v2xft" Jun 11 23:24:22.153034 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.153003 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh"] Jun 11 23:24:22.156450 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.156432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.159201 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.159174 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 23:24:22.159342 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.159199 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:24:22.159342 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.159199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-78rgf\"" Jun 11 23:24:22.159342 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.159181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:24:22.165774 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.165748 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh"] Jun 11 23:24:22.261837 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.261802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d8988b-9a93-4d6c-99a8-f5308aaa117a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.261837 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.261837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.262041 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.261871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5gz\" (UniqueName: \"kubernetes.io/projected/00d8988b-9a93-4d6c-99a8-f5308aaa117a-kube-api-access-zq5gz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.262041 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.261945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.262041 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.261990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.262150 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.262047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363348 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363531 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d8988b-9a93-4d6c-99a8-f5308aaa117a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363531 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363531 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5gz\" (UniqueName: \"kubernetes.io/projected/00d8988b-9a93-4d6c-99a8-f5308aaa117a-kube-api-access-zq5gz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363531 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363531 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363810 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363705 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363859 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.363891 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.363860 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.365852 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.365830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d8988b-9a93-4d6c-99a8-f5308aaa117a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.366110 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.366091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d8988b-9a93-4d6c-99a8-f5308aaa117a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.372451 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.372425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5gz\" (UniqueName: \"kubernetes.io/projected/00d8988b-9a93-4d6c-99a8-f5308aaa117a-kube-api-access-zq5gz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kx7vh\" (UID: \"00d8988b-9a93-4d6c-99a8-f5308aaa117a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.467682 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.467585 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:22.605841 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:22.605815 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh"] Jun 11 23:24:22.612208 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:24:22.612176 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d8988b_9a93_4d6c_99a8_f5308aaa117a.slice/crio-0f961112d8db0530c7a5832152afc26041a7312620181d6aff1ba5d9f4533b55 WatchSource:0}: Error finding container 0f961112d8db0530c7a5832152afc26041a7312620181d6aff1ba5d9f4533b55: Status 404 returned error can't find the container with id 0f961112d8db0530c7a5832152afc26041a7312620181d6aff1ba5d9f4533b55 Jun 11 23:24:23.067411 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:23.067369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" event={"ID":"00d8988b-9a93-4d6c-99a8-f5308aaa117a","Type":"ContainerStarted","Data":"0f961112d8db0530c7a5832152afc26041a7312620181d6aff1ba5d9f4533b55"} Jun 11 23:24:27.092453 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:27.092404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" event={"ID":"00d8988b-9a93-4d6c-99a8-f5308aaa117a","Type":"ContainerStarted","Data":"ded0ee3eb4aab4b3207f1f70eae98125bbbbeba64569199bab4355504fd0999e"} Jun 11 23:24:29.102525 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:29.102493 2581 generic.go:356] "Generic (PLEG): container finished" podID="00d8988b-9a93-4d6c-99a8-f5308aaa117a" containerID="ded0ee3eb4aab4b3207f1f70eae98125bbbbeba64569199bab4355504fd0999e" exitCode=0 Jun 11 23:24:29.102920 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:29.102532 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" event={"ID":"00d8988b-9a93-4d6c-99a8-f5308aaa117a","Type":"ContainerDied","Data":"ded0ee3eb4aab4b3207f1f70eae98125bbbbeba64569199bab4355504fd0999e"} Jun 11 23:24:31.113994 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:31.113959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" event={"ID":"00d8988b-9a93-4d6c-99a8-f5308aaa117a","Type":"ContainerStarted","Data":"2f6d619c26011ed700f1e836fdaccbef97a4eec61cb53ed5daa2ef6f69d8a735"} Jun 11 23:24:31.135040 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:31.134988 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" podStartSLOduration=2.317388496 podStartE2EDuration="9.134970899s" totalImagesPullingTime="4.754797535s" totalInitContainerRuntime="2.062784868s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:24:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:24:31.133626354 +0000 UTC m=+869.219552943" watchObservedRunningTime="2026-06-11 23:24:31.134970899 +0000 UTC m=+869.220897461" Jun 11 23:24:32.468105 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:32.468053 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:32.468637 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:32.468126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:32.480645 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:32.480622 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:33.134112 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:33.134084 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kx7vh" Jun 11 23:24:45.857453 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.857416 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5"] Jun 11 23:24:45.860822 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.860801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:45.862872 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.862850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 23:24:45.872125 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.872093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5"] Jun 11 23:24:45.967019 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.966980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7c524ae-4849-4aaa-be9e-5757a6192661-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:45.967203 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.967037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:45.967203 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.967127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm58b\" (UniqueName: \"kubernetes.io/projected/c7c524ae-4849-4aaa-be9e-5757a6192661-kube-api-access-xm58b\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:45.967203 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.967167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:45.967383 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.967247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:45.967383 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:45.967282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.068746 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.068708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm58b\" (UniqueName: \"kubernetes.io/projected/c7c524ae-4849-4aaa-be9e-5757a6192661-kube-api-access-xm58b\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.068746 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.068751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.068953 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.068801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.068953 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.068837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.068953 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.068883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7c524ae-4849-4aaa-be9e-5757a6192661-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.068953 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.068915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.069289 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.069265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.069328 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.069277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.069328 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.069307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.071413 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.071390 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7c524ae-4849-4aaa-be9e-5757a6192661-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.071521 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.071502 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7c524ae-4849-4aaa-be9e-5757a6192661-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.082961 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.082941 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm58b\" (UniqueName: \"kubernetes.io/projected/c7c524ae-4849-4aaa-be9e-5757a6192661-kube-api-access-xm58b\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5\" (UID: \"c7c524ae-4849-4aaa-be9e-5757a6192661\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.172025 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.171926 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:46.318381 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:46.318271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5"] Jun 11 23:24:46.321077 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:24:46.321053 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c524ae_4849_4aaa_be9e_5757a6192661.slice/crio-d7986e7546a2bc7c59ee363e0d9daab83889dba2c38fc5332a5b0344192d5484 WatchSource:0}: Error finding container d7986e7546a2bc7c59ee363e0d9daab83889dba2c38fc5332a5b0344192d5484: Status 404 returned error can't find the container with id d7986e7546a2bc7c59ee363e0d9daab83889dba2c38fc5332a5b0344192d5484 Jun 11 23:24:47.187463 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:47.187420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" event={"ID":"c7c524ae-4849-4aaa-be9e-5757a6192661","Type":"ContainerStarted","Data":"85dd284259f1a5f9a6106606f9eb4828885dfd12f536a1993e06f2b07249efd5"} Jun 11 23:24:47.187882 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:47.187484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" event={"ID":"c7c524ae-4849-4aaa-be9e-5757a6192661","Type":"ContainerStarted","Data":"d7986e7546a2bc7c59ee363e0d9daab83889dba2c38fc5332a5b0344192d5484"} Jun 11 23:24:53.218761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:53.218681 2581 generic.go:356] "Generic (PLEG): container finished" podID="c7c524ae-4849-4aaa-be9e-5757a6192661" containerID="85dd284259f1a5f9a6106606f9eb4828885dfd12f536a1993e06f2b07249efd5" exitCode=0 Jun 11 23:24:53.218761 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:53.218750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" event={"ID":"c7c524ae-4849-4aaa-be9e-5757a6192661","Type":"ContainerDied","Data":"85dd284259f1a5f9a6106606f9eb4828885dfd12f536a1993e06f2b07249efd5"} Jun 11 23:24:54.226013 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:54.225982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" event={"ID":"c7c524ae-4849-4aaa-be9e-5757a6192661","Type":"ContainerStarted","Data":"12f35ea4a01208327cae65cd1bf32b21343b86faf22b7f652acd6d48089ec757"} Jun 11 23:24:54.245820 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:54.245768 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" podStartSLOduration=2.472847967 podStartE2EDuration="9.245751957s" totalImagesPullingTime="191.331951ms" totalInitContainerRuntime="6.581572039s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:24:54.244010033 +0000 UTC m=+892.329936641" watchObservedRunningTime="2026-06-11 23:24:54.245751957 +0000 UTC m=+892.331678520" Jun 11 23:24:56.172661 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:56.172602 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:56.173088 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:56.172696 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:56.185799 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:56.185771 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:24:56.248442 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:24:56.248402 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5" Jun 11 23:25:02.418026 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:02.418000 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:25:02.418733 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:02.418713 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:25:02.956654 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:02.956619 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f"] Jun 11 23:25:02.970620 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:02.970594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:02.970913 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:02.970887 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f"] Jun 11 23:25:02.972840 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:02.972817 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 23:25:03.110491 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.110456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.110757 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.110506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.110757 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.110529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.110757 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.110585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.110757 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.110660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8782812f-e4c4-4db0-a36b-74faa34757fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.110757 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.110720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j27lg\" (UniqueName: \"kubernetes.io/projected/8782812f-e4c4-4db0-a36b-74faa34757fb-kube-api-access-j27lg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211289 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8782812f-e4c4-4db0-a36b-74faa34757fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211289 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j27lg\" (UniqueName: \"kubernetes.io/projected/8782812f-e4c4-4db0-a36b-74faa34757fb-kube-api-access-j27lg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211492 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211492 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211492 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211679 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211833 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211921 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211829 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.211921 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.211899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.213684 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.213653 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8782812f-e4c4-4db0-a36b-74faa34757fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.213941 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.213924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8782812f-e4c4-4db0-a36b-74faa34757fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.219696 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.219677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j27lg\" (UniqueName: \"kubernetes.io/projected/8782812f-e4c4-4db0-a36b-74faa34757fb-kube-api-access-j27lg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9pw6f\" (UID: \"8782812f-e4c4-4db0-a36b-74faa34757fb\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.280911 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.280877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:03.422672 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:03.422615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f"] Jun 11 23:25:03.424914 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:25:03.424872 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8782812f_e4c4_4db0_a36b_74faa34757fb.slice/crio-989522fd217f6dfdc382cc84dd653876da5f0dbb9c37727039b48da0822e9061 WatchSource:0}: Error finding container 989522fd217f6dfdc382cc84dd653876da5f0dbb9c37727039b48da0822e9061: Status 404 returned error can't find the container with id 989522fd217f6dfdc382cc84dd653876da5f0dbb9c37727039b48da0822e9061 Jun 11 23:25:04.274172 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:04.274139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" event={"ID":"8782812f-e4c4-4db0-a36b-74faa34757fb","Type":"ContainerStarted","Data":"2057fecc8f84449aa3d924c9e50433ac061135be30206cc604988084071f4b0a"} Jun 11 23:25:04.274364 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:04.274182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" event={"ID":"8782812f-e4c4-4db0-a36b-74faa34757fb","Type":"ContainerStarted","Data":"989522fd217f6dfdc382cc84dd653876da5f0dbb9c37727039b48da0822e9061"} Jun 11 23:25:07.289514 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:07.289477 2581 generic.go:356] "Generic (PLEG): container finished" podID="8782812f-e4c4-4db0-a36b-74faa34757fb" containerID="2057fecc8f84449aa3d924c9e50433ac061135be30206cc604988084071f4b0a" exitCode=0 Jun 11 23:25:07.289926 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:07.289570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" event={"ID":"8782812f-e4c4-4db0-a36b-74faa34757fb","Type":"ContainerDied","Data":"2057fecc8f84449aa3d924c9e50433ac061135be30206cc604988084071f4b0a"} Jun 11 23:25:08.298536 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:08.298504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" event={"ID":"8782812f-e4c4-4db0-a36b-74faa34757fb","Type":"ContainerStarted","Data":"e6d920bc80b8a8adbe191b68ef583aec3f91126848720b11cf4462692f85348b"} Jun 11 23:25:08.318908 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:08.318851 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" podStartSLOduration=2.810435345 podStartE2EDuration="6.318833549s" totalImagesPullingTime="192.116549ms" totalInitContainerRuntime="3.316281655s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:25:08.316448315 +0000 UTC m=+906.402374896" watchObservedRunningTime="2026-06-11 23:25:08.318833549 +0000 UTC m=+906.404760111" Jun 11 23:25:13.281325 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:13.281287 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:13.281866 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:13.281348 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:13.294243 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:13.294216 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:25:13.331489 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:25:13.331462 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9pw6f" Jun 11 23:26:18.936473 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:18.936386 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59b4c8b45-f226m"] Jun 11 23:26:18.938526 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:18.938510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:18.949500 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:18.949475 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-f226m"] Jun 11 23:26:18.979445 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:18.979413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rlv\" (UniqueName: \"kubernetes.io/projected/fe3e4f9d-36da-4858-a55c-15618af26155-kube-api-access-l6rlv\") pod \"maas-controller-59b4c8b45-f226m\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:18.979625 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:18.979517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe3e4f9d-36da-4858-a55c-15618af26155-webhook-cert\") pod \"maas-controller-59b4c8b45-f226m\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:19.080266 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.080232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe3e4f9d-36da-4858-a55c-15618af26155-webhook-cert\") pod \"maas-controller-59b4c8b45-f226m\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:19.080445 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.080275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rlv\" (UniqueName: \"kubernetes.io/projected/fe3e4f9d-36da-4858-a55c-15618af26155-kube-api-access-l6rlv\") pod \"maas-controller-59b4c8b45-f226m\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:19.082829 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.082804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe3e4f9d-36da-4858-a55c-15618af26155-webhook-cert\") pod \"maas-controller-59b4c8b45-f226m\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:19.088862 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.088836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rlv\" (UniqueName: \"kubernetes.io/projected/fe3e4f9d-36da-4858-a55c-15618af26155-kube-api-access-l6rlv\") pod \"maas-controller-59b4c8b45-f226m\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:19.250085 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.249988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:19.383798 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.383771 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-f226m"] Jun 11 23:26:19.385953 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:26:19.385923 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3e4f9d_36da_4858_a55c_15618af26155.slice/crio-45f9c8345368f463ad23260972c733aa33b920205cd1aea5426951e06dbd07b5 WatchSource:0}: Error finding container 45f9c8345368f463ad23260972c733aa33b920205cd1aea5426951e06dbd07b5: Status 404 returned error can't find the container with id 45f9c8345368f463ad23260972c733aa33b920205cd1aea5426951e06dbd07b5 Jun 11 23:26:19.387227 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.387205 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:26:19.638616 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.638582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4c8b45-f226m" event={"ID":"fe3e4f9d-36da-4858-a55c-15618af26155","Type":"ContainerStarted","Data":"45f9c8345368f463ad23260972c733aa33b920205cd1aea5426951e06dbd07b5"} Jun 11 23:26:19.819752 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:19.819729 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:26:20.645389 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:20.645343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4c8b45-f226m" event={"ID":"fe3e4f9d-36da-4858-a55c-15618af26155","Type":"ContainerStarted","Data":"0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463"} Jun 11 23:26:20.645933 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:20.645431 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:20.664807 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:20.664751 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59b4c8b45-f226m" podStartSLOduration=2.234804503 podStartE2EDuration="2.664732758s" totalImagesPullingTime="429.928255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:26:20.662406016 +0000 UTC m=+978.748332578" watchObservedRunningTime="2026-06-11 23:26:20.664732758 +0000 UTC m=+978.750659319" Jun 11 23:26:31.657201 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:31.657168 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:26:31.725545 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:31.725503 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65b78f8549-7brfw"] Jun 11 23:26:31.725872 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:31.725816 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65b78f8549-7brfw" podUID="77b3be26-3958-49ce-b212-f94caca9d5bf" containerName="manager" containerID="cri-o://0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398" gracePeriod=30 Jun 11 23:26:31.980095 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:31.980060 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:26:32.094667 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.094628 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert\") pod \"77b3be26-3958-49ce-b212-f94caca9d5bf\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " Jun 11 23:26:32.094846 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.094689 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxxv7\" (UniqueName: \"kubernetes.io/projected/77b3be26-3958-49ce-b212-f94caca9d5bf-kube-api-access-xxxv7\") pod \"77b3be26-3958-49ce-b212-f94caca9d5bf\" (UID: \"77b3be26-3958-49ce-b212-f94caca9d5bf\") " Jun 11 23:26:32.096917 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.096879 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "77b3be26-3958-49ce-b212-f94caca9d5bf" (UID: "77b3be26-3958-49ce-b212-f94caca9d5bf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:26:32.097033 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.096975 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b3be26-3958-49ce-b212-f94caca9d5bf-kube-api-access-xxxv7" (OuterVolumeSpecName: "kube-api-access-xxxv7") pod "77b3be26-3958-49ce-b212-f94caca9d5bf" (UID: "77b3be26-3958-49ce-b212-f94caca9d5bf"). InnerVolumeSpecName "kube-api-access-xxxv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:26:32.196158 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.196120 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77b3be26-3958-49ce-b212-f94caca9d5bf-webhook-cert\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:26:32.196158 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.196151 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxxv7\" (UniqueName: \"kubernetes.io/projected/77b3be26-3958-49ce-b212-f94caca9d5bf-kube-api-access-xxxv7\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:26:32.706843 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.706754 2581 generic.go:356] "Generic (PLEG): container finished" podID="77b3be26-3958-49ce-b212-f94caca9d5bf" containerID="0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398" exitCode=0 Jun 11 23:26:32.706843 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.706808 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b78f8549-7brfw" Jun 11 23:26:32.707278 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.706881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b78f8549-7brfw" event={"ID":"77b3be26-3958-49ce-b212-f94caca9d5bf","Type":"ContainerDied","Data":"0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398"} Jun 11 23:26:32.707278 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.706927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b78f8549-7brfw" event={"ID":"77b3be26-3958-49ce-b212-f94caca9d5bf","Type":"ContainerDied","Data":"8a183ceacb94633bf5e2f3062a7dfe39d2b1e0bc8cdb919229d0952df50b3174"} Jun 11 23:26:32.707278 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.706949 2581 scope.go:117] "RemoveContainer" containerID="0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398" Jun 11 23:26:32.715732 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.715712 2581 scope.go:117] "RemoveContainer" containerID="0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398" Jun 11 23:26:32.715993 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:26:32.715972 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398\": container with ID starting with 0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398 not found: ID does not exist" containerID="0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398" Jun 11 23:26:32.716070 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.716002 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398"} err="failed to get container status \"0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398\": rpc error: code = NotFound desc = could not find container \"0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398\": container with ID starting with 0eb1342b932159c5404a2691f9267d06c4b6ea5ae58e12b163deecce8019f398 not found: ID does not exist" Jun 11 23:26:32.722606 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.722579 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65b78f8549-7brfw"] Jun 11 23:26:32.727200 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:32.727178 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65b78f8549-7brfw"] Jun 11 23:26:34.410804 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:26:34.410771 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b3be26-3958-49ce-b212-f94caca9d5bf" path="/var/lib/kubelet/pods/77b3be26-3958-49ce-b212-f94caca9d5bf/volumes" Jun 11 23:27:57.614710 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.614628 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-f226m"] Jun 11 23:27:57.615263 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.614894 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-59b4c8b45-f226m" podUID="fe3e4f9d-36da-4858-a55c-15618af26155" containerName="manager" containerID="cri-o://0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463" gracePeriod=30 Jun 11 23:27:57.861519 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.861494 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:27:57.942251 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.942172 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe3e4f9d-36da-4858-a55c-15618af26155-webhook-cert\") pod \"fe3e4f9d-36da-4858-a55c-15618af26155\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " Jun 11 23:27:57.942251 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.942240 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6rlv\" (UniqueName: \"kubernetes.io/projected/fe3e4f9d-36da-4858-a55c-15618af26155-kube-api-access-l6rlv\") pod \"fe3e4f9d-36da-4858-a55c-15618af26155\" (UID: \"fe3e4f9d-36da-4858-a55c-15618af26155\") " Jun 11 23:27:57.944309 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.944278 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3e4f9d-36da-4858-a55c-15618af26155-kube-api-access-l6rlv" (OuterVolumeSpecName: "kube-api-access-l6rlv") pod "fe3e4f9d-36da-4858-a55c-15618af26155" (UID: "fe3e4f9d-36da-4858-a55c-15618af26155"). InnerVolumeSpecName "kube-api-access-l6rlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:27:57.944417 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:57.944286 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe3e4f9d-36da-4858-a55c-15618af26155-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe3e4f9d-36da-4858-a55c-15618af26155" (UID: "fe3e4f9d-36da-4858-a55c-15618af26155"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:27:58.043683 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.043648 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6rlv\" (UniqueName: \"kubernetes.io/projected/fe3e4f9d-36da-4858-a55c-15618af26155-kube-api-access-l6rlv\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:27:58.043683 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.043678 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe3e4f9d-36da-4858-a55c-15618af26155-webhook-cert\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:27:58.126448 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.126412 2581 generic.go:356] "Generic (PLEG): container finished" podID="fe3e4f9d-36da-4858-a55c-15618af26155" containerID="0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463" exitCode=0 Jun 11 23:27:58.126650 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.126464 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4c8b45-f226m" Jun 11 23:27:58.126650 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.126501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4c8b45-f226m" event={"ID":"fe3e4f9d-36da-4858-a55c-15618af26155","Type":"ContainerDied","Data":"0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463"} Jun 11 23:27:58.126650 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.126616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4c8b45-f226m" event={"ID":"fe3e4f9d-36da-4858-a55c-15618af26155","Type":"ContainerDied","Data":"45f9c8345368f463ad23260972c733aa33b920205cd1aea5426951e06dbd07b5"} Jun 11 23:27:58.126650 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.126641 2581 scope.go:117] "RemoveContainer" containerID="0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463" Jun 11 23:27:58.136017 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.135998 2581 scope.go:117] "RemoveContainer" containerID="0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463" Jun 11 23:27:58.136275 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:27:58.136257 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463\": container with ID starting with 0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463 not found: ID does not exist" containerID="0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463" Jun 11 23:27:58.136315 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.136284 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463"} err="failed to get container status \"0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463\": rpc error: code = NotFound desc = could not find container \"0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463\": container with ID starting with 0e2ceecd832a84107fc2c806af2628e63f88d3973b643b8088fe1dc0a428d463 not found: ID does not exist" Jun 11 23:27:58.146478 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.146454 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-f226m"] Jun 11 23:27:58.150383 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.150364 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-f226m"] Jun 11 23:27:58.410400 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.410364 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3e4f9d-36da-4858-a55c-15618af26155" path="/var/lib/kubelet/pods/fe3e4f9d-36da-4858-a55c-15618af26155/volumes" Jun 11 23:27:58.928489 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928454 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59b4c8b45-sqcml"] Jun 11 23:27:58.928877 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928817 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b3be26-3958-49ce-b212-f94caca9d5bf" containerName="manager" Jun 11 23:27:58.928877 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928829 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b3be26-3958-49ce-b212-f94caca9d5bf" containerName="manager" Jun 11 23:27:58.928877 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928855 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3e4f9d-36da-4858-a55c-15618af26155" containerName="manager" Jun 11 23:27:58.928877 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928860 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3e4f9d-36da-4858-a55c-15618af26155" containerName="manager" Jun 11 23:27:58.929020 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928910 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3e4f9d-36da-4858-a55c-15618af26155" containerName="manager" Jun 11 23:27:58.929020 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.928917 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b3be26-3958-49ce-b212-f94caca9d5bf" containerName="manager" Jun 11 23:27:58.931477 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.931460 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:58.934255 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.934233 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 23:27:58.934375 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.934258 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:27:58.934375 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.934235 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjbtx\"" Jun 11 23:27:58.946609 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:58.946587 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-sqcml"] Jun 11 23:27:59.052059 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.052025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66hhk\" (UniqueName: \"kubernetes.io/projected/c018b4f4-833d-4735-9011-bd72c826b4b5-kube-api-access-66hhk\") pod \"maas-controller-59b4c8b45-sqcml\" (UID: \"c018b4f4-833d-4735-9011-bd72c826b4b5\") " pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.052251 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.052097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c018b4f4-833d-4735-9011-bd72c826b4b5-webhook-cert\") pod \"maas-controller-59b4c8b45-sqcml\" (UID: \"c018b4f4-833d-4735-9011-bd72c826b4b5\") " pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.153436 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.153406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66hhk\" (UniqueName: \"kubernetes.io/projected/c018b4f4-833d-4735-9011-bd72c826b4b5-kube-api-access-66hhk\") pod \"maas-controller-59b4c8b45-sqcml\" (UID: \"c018b4f4-833d-4735-9011-bd72c826b4b5\") " pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.153639 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.153467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c018b4f4-833d-4735-9011-bd72c826b4b5-webhook-cert\") pod \"maas-controller-59b4c8b45-sqcml\" (UID: \"c018b4f4-833d-4735-9011-bd72c826b4b5\") " pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.156096 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.156077 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c018b4f4-833d-4735-9011-bd72c826b4b5-webhook-cert\") pod \"maas-controller-59b4c8b45-sqcml\" (UID: \"c018b4f4-833d-4735-9011-bd72c826b4b5\") " pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.161968 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.161943 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66hhk\" (UniqueName: \"kubernetes.io/projected/c018b4f4-833d-4735-9011-bd72c826b4b5-kube-api-access-66hhk\") pod \"maas-controller-59b4c8b45-sqcml\" (UID: \"c018b4f4-833d-4735-9011-bd72c826b4b5\") " pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.242080 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.241994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:27:59.381298 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:27:59.381272 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b4c8b45-sqcml"] Jun 11 23:27:59.383409 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:27:59.383371 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc018b4f4_833d_4735_9011_bd72c826b4b5.slice/crio-45d9edc51eaf84283e304eda7242aef021ed56cfa852a815e5742d4b0956b9d7 WatchSource:0}: Error finding container 45d9edc51eaf84283e304eda7242aef021ed56cfa852a815e5742d4b0956b9d7: Status 404 returned error can't find the container with id 45d9edc51eaf84283e304eda7242aef021ed56cfa852a815e5742d4b0956b9d7 Jun 11 23:28:00.139626 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:28:00.139596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4c8b45-sqcml" event={"ID":"c018b4f4-833d-4735-9011-bd72c826b4b5","Type":"ContainerStarted","Data":"edfe4bd9d8975d76121d2c5463d3d45fd1c6f5baed4e4c2da603b317ab440b42"} Jun 11 23:28:00.140036 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:28:00.139650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4c8b45-sqcml" event={"ID":"c018b4f4-833d-4735-9011-bd72c826b4b5","Type":"ContainerStarted","Data":"45d9edc51eaf84283e304eda7242aef021ed56cfa852a815e5742d4b0956b9d7"} Jun 11 23:28:00.140036 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:28:00.139673 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:28:00.156247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:28:00.156196 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59b4c8b45-sqcml" podStartSLOduration=1.720449814 podStartE2EDuration="2.156181313s" totalImagesPullingTime="435.731499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:28:00.155198882 +0000 UTC m=+1078.241125438" watchObservedRunningTime="2026-06-11 23:28:00.156181313 +0000 UTC m=+1078.242107874" Jun 11 23:28:11.149724 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:28:11.149686 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59b4c8b45-sqcml" Jun 11 23:30:02.446673 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:30:02.446644 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:30:02.449681 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:30:02.449661 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:35:02.473080 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:02.473051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:35:02.477280 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:02.477262 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:35:38.653201 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.653119 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9"] Jun 11 23:35:38.653787 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.653386 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" podUID="374be118-a5dd-4d50-b1c1-52232c236b67" containerName="manager" containerID="cri-o://22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e" gracePeriod=10 Jun 11 23:35:38.907465 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.907397 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:35:38.938157 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.938121 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/374be118-a5dd-4d50-b1c1-52232c236b67-extensions-socket-volume\") pod \"374be118-a5dd-4d50-b1c1-52232c236b67\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " Jun 11 23:35:38.938343 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.938194 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj8m6\" (UniqueName: \"kubernetes.io/projected/374be118-a5dd-4d50-b1c1-52232c236b67-kube-api-access-lj8m6\") pod \"374be118-a5dd-4d50-b1c1-52232c236b67\" (UID: \"374be118-a5dd-4d50-b1c1-52232c236b67\") " Jun 11 23:35:38.938646 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.938615 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374be118-a5dd-4d50-b1c1-52232c236b67-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "374be118-a5dd-4d50-b1c1-52232c236b67" (UID: "374be118-a5dd-4d50-b1c1-52232c236b67"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:35:38.940556 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:38.940509 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374be118-a5dd-4d50-b1c1-52232c236b67-kube-api-access-lj8m6" (OuterVolumeSpecName: "kube-api-access-lj8m6") pod "374be118-a5dd-4d50-b1c1-52232c236b67" (UID: "374be118-a5dd-4d50-b1c1-52232c236b67"). InnerVolumeSpecName "kube-api-access-lj8m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:35:39.039096 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.039062 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/374be118-a5dd-4d50-b1c1-52232c236b67-extensions-socket-volume\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:35:39.039096 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.039092 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj8m6\" (UniqueName: \"kubernetes.io/projected/374be118-a5dd-4d50-b1c1-52232c236b67-kube-api-access-lj8m6\") on node \"ip-10-0-143-190.ec2.internal\" DevicePath \"\"" Jun 11 23:35:39.379730 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.379696 2581 generic.go:356] "Generic (PLEG): container finished" podID="374be118-a5dd-4d50-b1c1-52232c236b67" containerID="22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e" exitCode=0 Jun 11 23:35:39.379924 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.379741 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" Jun 11 23:35:39.379924 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.379784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" event={"ID":"374be118-a5dd-4d50-b1c1-52232c236b67","Type":"ContainerDied","Data":"22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e"} Jun 11 23:35:39.379924 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.379863 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9" event={"ID":"374be118-a5dd-4d50-b1c1-52232c236b67","Type":"ContainerDied","Data":"003b850e1e98c0e79233a2fd35a39df85db962d9e266b3b248160dcfbfeaa0ab"} Jun 11 23:35:39.379924 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.379886 2581 scope.go:117] "RemoveContainer" containerID="22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e" Jun 11 23:35:39.389382 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.389364 2581 scope.go:117] "RemoveContainer" containerID="22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e" Jun 11 23:35:39.389672 ip-10-0-143-190 kubenswrapper[2581]: E0611 23:35:39.389647 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e\": container with ID starting with 22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e not found: ID does not exist" containerID="22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e" Jun 11 23:35:39.389723 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.389686 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e"} err="failed to get container status \"22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e\": rpc error: code = NotFound desc = could not find container \"22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e\": container with ID starting with 22f7c5c02f0e4cd12a4db24d513a25759d40318cc458f719a3d59f7958255b1e not found: ID does not exist" Jun 11 23:35:39.401664 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.401641 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9"] Jun 11 23:35:39.406319 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:39.406298 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s54h9"] Jun 11 23:35:40.410021 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:35:40.409985 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="374be118-a5dd-4d50-b1c1-52232c236b67" path="/var/lib/kubelet/pods/374be118-a5dd-4d50-b1c1-52232c236b67/volumes" Jun 11 23:36:44.838625 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.838519 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql"] Jun 11 23:36:44.839121 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.838920 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374be118-a5dd-4d50-b1c1-52232c236b67" containerName="manager" Jun 11 23:36:44.839121 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.838932 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="374be118-a5dd-4d50-b1c1-52232c236b67" containerName="manager" Jun 11 23:36:44.839121 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.838997 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="374be118-a5dd-4d50-b1c1-52232c236b67" containerName="manager" Jun 11 23:36:44.842012 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.841994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:44.846918 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.846897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7ddwd\"" Jun 11 23:36:44.862100 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.862074 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql"] Jun 11 23:36:44.928434 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.928400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s27xx\" (UniqueName: \"kubernetes.io/projected/70818cc6-7abb-4995-b456-4a67c5daa9c3-kube-api-access-s27xx\") pod \"kuadrant-operator-controller-manager-86878c769f-hd4ql\" (UID: \"70818cc6-7abb-4995-b456-4a67c5daa9c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:44.928671 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:44.928445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70818cc6-7abb-4995-b456-4a67c5daa9c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hd4ql\" (UID: \"70818cc6-7abb-4995-b456-4a67c5daa9c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.029778 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.029745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s27xx\" (UniqueName: \"kubernetes.io/projected/70818cc6-7abb-4995-b456-4a67c5daa9c3-kube-api-access-s27xx\") pod \"kuadrant-operator-controller-manager-86878c769f-hd4ql\" (UID: \"70818cc6-7abb-4995-b456-4a67c5daa9c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.029971 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.029787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70818cc6-7abb-4995-b456-4a67c5daa9c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hd4ql\" (UID: \"70818cc6-7abb-4995-b456-4a67c5daa9c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.030132 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.030115 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70818cc6-7abb-4995-b456-4a67c5daa9c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hd4ql\" (UID: \"70818cc6-7abb-4995-b456-4a67c5daa9c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.041247 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.041225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s27xx\" (UniqueName: \"kubernetes.io/projected/70818cc6-7abb-4995-b456-4a67c5daa9c3-kube-api-access-s27xx\") pod \"kuadrant-operator-controller-manager-86878c769f-hd4ql\" (UID: \"70818cc6-7abb-4995-b456-4a67c5daa9c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.152315 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.152283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.311219 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.311192 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql"] Jun 11 23:36:45.314281 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:36:45.314255 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70818cc6_7abb_4995_b456_4a67c5daa9c3.slice/crio-a5df4c33358a397fe1121e26926dd012c7f4861b63d6bfc55ac6b9396c6d53f6 WatchSource:0}: Error finding container a5df4c33358a397fe1121e26926dd012c7f4861b63d6bfc55ac6b9396c6d53f6: Status 404 returned error can't find the container with id a5df4c33358a397fe1121e26926dd012c7f4861b63d6bfc55ac6b9396c6d53f6 Jun 11 23:36:45.695309 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.695275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" event={"ID":"70818cc6-7abb-4995-b456-4a67c5daa9c3","Type":"ContainerStarted","Data":"5f5f82d2471233ecf1c9c2ac4cdb53591451afd93e5ef7036329c4e88c21e3ae"} Jun 11 23:36:45.695477 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.695327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" event={"ID":"70818cc6-7abb-4995-b456-4a67c5daa9c3","Type":"ContainerStarted","Data":"a5df4c33358a397fe1121e26926dd012c7f4861b63d6bfc55ac6b9396c6d53f6"} Jun 11 23:36:45.695477 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.695466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:36:45.721806 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:45.721742 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" podStartSLOduration=1.721721594 podStartE2EDuration="1.721721594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:45.721273566 +0000 UTC m=+1603.807200148" watchObservedRunningTime="2026-06-11 23:36:45.721721594 +0000 UTC m=+1603.807648158" Jun 11 23:36:56.703141 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:36:56.703110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hd4ql" Jun 11 23:40:02.500608 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:40:02.500478 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:40:02.507330 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:40:02.504734 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:45:02.529725 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:45:02.529621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:45:02.534712 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:45:02.534693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:50:02.557140 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:50:02.557027 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:50:02.563174 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:50:02.563156 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:54:57.072519 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:57.072489 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d79f9cfb6-8bp49_84b058a0-6345-408a-ae2f-d750bb7dab38/nginx/0.log" Jun 11 23:54:57.284666 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:57.284637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-q4g76_7de1a033-ad8c-4d43-aba4-a77f24024876/manager/0.log" Jun 11 23:54:57.400367 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:57.400333 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-jvdrc_5fe5b788-7938-48a2-a24d-48ba9d3a3dc2/manager/0.log" Jun 11 23:54:57.517510 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:57.517480 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fd589bf7-z9jrh_6945b19e-fef7-407d-aa34-ec4db297f730/maas-api/0.log" Jun 11 23:54:57.860128 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:57.860103 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59b4c8b45-sqcml_c018b4f4-833d-4735-9011-bd72c826b4b5/manager/0.log" Jun 11 23:54:57.969882 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:57.969855 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6wsnc_e0f29d92-314f-4c72-bd3b-7ecaef321edb/server/0.log" Jun 11 23:54:58.089033 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:58.089002 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ftq6j_c3858a7d-87b7-433c-9f52-1babb932ddf7/manager/0.log" Jun 11 23:54:58.460948 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:58.460921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-zkz7x_13656011-9fe5-472d-8129-1150e06d01a8/copy-manifests/0.log" Jun 11 23:54:58.473016 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:54:58.472991 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-zkz7x_13656011-9fe5-472d-8129-1150e06d01a8/manager/0.log" Jun 11 23:55:00.100788 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:00.100761 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lgspx_a67ab12c-a19e-4bdb-8a67-3a251dd084fa/manager/0.log" Jun 11 23:55:00.462288 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:00.462261 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hd4ql_70818cc6-7abb-4995-b456-4a67c5daa9c3/manager/0.log" Jun 11 23:55:00.706733 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:00.706699 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mnz8g_50651648-79db-4641-a2df-ec7810ae062a/manager/0.log" Jun 11 23:55:01.202629 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:01.202599 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gtmjx_63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0/discovery/0.log" Jun 11 23:55:01.456963 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:01.456889 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-ghwpm_4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461/kube-auth-proxy/0.log" Jun 11 23:55:01.834338 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:01.834261 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-v2xft_2ce7e59b-1dad-4b89-b0b3-a52708740fc9/payload-processing/0.log" Jun 11 23:55:02.419414 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.419384 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-kx7vh_00d8988b-9a93-4d6c-99a8-f5308aaa117a/storage-initializer/0.log" Jun 11 23:55:02.426748 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.426725 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-kx7vh_00d8988b-9a93-4d6c-99a8-f5308aaa117a/main/0.log" Jun 11 23:55:02.587243 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.587123 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:55:02.593882 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.593862 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2qzv_65ff678b-f159-4d71-a6c0-8144faeec48f/ovn-acl-logging/0.log" Jun 11 23:55:02.784404 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.784318 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5_c7c524ae-4849-4aaa-be9e-5757a6192661/storage-initializer/0.log" Jun 11 23:55:02.791908 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.791883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cwhx5_c7c524ae-4849-4aaa-be9e-5757a6192661/main/0.log" Jun 11 23:55:02.907187 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.907158 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9pw6f_8782812f-e4c4-4db0-a36b-74faa34757fb/storage-initializer/0.log" Jun 11 23:55:02.914199 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:02.914177 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9pw6f_8782812f-e4c4-4db0-a36b-74faa34757fb/main/0.log" Jun 11 23:55:09.987632 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:09.987602 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtknb_16a33568-12c5-418e-9824-4dd48eaa26c7/global-pull-secret-syncer/0.log" Jun 11 23:55:10.153638 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:10.153604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sstg2_067c87ce-cdba-493d-b6be-59a64827370f/konnectivity-agent/0.log" Jun 11 23:55:10.255490 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:10.255407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-190.ec2.internal_92a9fbefb60d8cd75a07802386812876/haproxy/0.log" Jun 11 23:55:13.612441 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:13.612407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-9skvb_148bfe8f-ed72-4b01-a003-38f91cc32a11/sail-operator/0.log" Jun 11 23:55:15.225114 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:15.225082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lgspx_a67ab12c-a19e-4bdb-8a67-3a251dd084fa/manager/0.log" Jun 11 23:55:15.397481 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:15.397450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hd4ql_70818cc6-7abb-4995-b456-4a67c5daa9c3/manager/0.log" Jun 11 23:55:15.501108 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:15.501024 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mnz8g_50651648-79db-4641-a2df-ec7810ae062a/manager/0.log" Jun 11 23:55:17.638549 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:17.638513 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtn6z_b6bc0434-f9bf-412a-bdd9-c03178d87e83/node-exporter/0.log" Jun 11 23:55:17.671833 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:17.671808 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtn6z_b6bc0434-f9bf-412a-bdd9-c03178d87e83/kube-rbac-proxy/0.log" Jun 11 23:55:17.698061 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:17.698039 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtn6z_b6bc0434-f9bf-412a-bdd9-c03178d87e83/init-textfile/0.log" Jun 11 23:55:21.117185 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:21.117128 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-w4hqz_918b2327-64dd-4c17-8057-efbae8196667/download-server/0.log" Jun 11 23:55:22.014471 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.014438 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf"] Jun 11 23:55:22.017962 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.017941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.020224 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.020194 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k62db\"/\"openshift-service-ca.crt\"" Jun 11 23:55:22.021261 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.021235 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k62db\"/\"kube-root-ca.crt\"" Jun 11 23:55:22.021261 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.021254 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k62db\"/\"default-dockercfg-xddgz\"" Jun 11 23:55:22.024110 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.024076 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf"] Jun 11 23:55:22.140002 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.139962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-lib-modules\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.140378 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.140007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-proc\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.140378 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.140068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-sys\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.140378 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.140092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-podres\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.140378 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.140119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5gd\" (UniqueName: \"kubernetes.io/projected/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-kube-api-access-wb5gd\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241313 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-proc\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-sys\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-podres\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5gd\" (UniqueName: \"kubernetes.io/projected/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-kube-api-access-wb5gd\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-proc\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241516 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241469 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-sys\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-lib-modules\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241547 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-podres\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.241735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.241711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-lib-modules\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.248867 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.248837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5gd\" (UniqueName: \"kubernetes.io/projected/3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f-kube-api-access-wb5gd\") pod \"perf-node-gather-daemonset-8m7wf\" (UID: \"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.329395 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.329294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:22.467865 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:22.467836 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf"] Jun 11 23:55:22.469919 ip-10-0-143-190 kubenswrapper[2581]: W0611 23:55:22.469873 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b68fdd0_3d7e_4e12_b204_f1aa83d2ab7f.slice/crio-a3ab00dea1501390da59d6c926801c6662adce0b8f95cb1dbfa6ee282c31b592 WatchSource:0}: Error finding container a3ab00dea1501390da59d6c926801c6662adce0b8f95cb1dbfa6ee282c31b592: Status 404 returned error can't find the container with id a3ab00dea1501390da59d6c926801c6662adce0b8f95cb1dbfa6ee282c31b592 Jun 11 23:55:23.005191 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.005153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" event={"ID":"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f","Type":"ContainerStarted","Data":"4e3e0b319419b76a29285cbe98065313014548473be574c85a052cc343593f99"} Jun 11 23:55:23.005351 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.005224 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:23.005351 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.005249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" event={"ID":"3b68fdd0-3d7e-4e12-b204-f1aa83d2ab7f","Type":"ContainerStarted","Data":"a3ab00dea1501390da59d6c926801c6662adce0b8f95cb1dbfa6ee282c31b592"} Jun 11 23:55:23.021028 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.020968 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" podStartSLOduration=1.020950229 podStartE2EDuration="1.020950229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:55:23.019227956 +0000 UTC m=+2721.105154517" watchObservedRunningTime="2026-06-11 23:55:23.020950229 +0000 UTC m=+2721.106876790" Jun 11 23:55:23.152001 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.151949 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m4k4n_bdba22a5-6e6a-49f8-9051-2cd01ec03ff9/dns/0.log" Jun 11 23:55:23.174182 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.174152 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m4k4n_bdba22a5-6e6a-49f8-9051-2cd01ec03ff9/kube-rbac-proxy/0.log" Jun 11 23:55:23.313748 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.313658 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p562h_187e60e2-0625-4d01-a77e-3d4db6f87a91/dns-node-resolver/0.log" Jun 11 23:55:23.843681 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.843653 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76c955587f-z2gfz_7cb1a3c2-b209-4c75-b4ac-57281e7d2e99/registry/0.log" Jun 11 23:55:23.863324 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:23.863299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cjgvx_c201ca53-89c9-4125-be2c-ab2e0b2569b3/node-ca/0.log" Jun 11 23:55:24.906290 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:24.906254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gtmjx_63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0/discovery/0.log" Jun 11 23:55:24.954274 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:24.954249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-ghwpm_4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461/kube-auth-proxy/0.log" Jun 11 23:55:25.104121 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:25.104085 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-v2xft_2ce7e59b-1dad-4b89-b0b3-a52708740fc9/payload-processing/0.log" Jun 11 23:55:25.816877 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:25.816847 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjxht_480703bb-f7a8-4b45-807d-bf057019ec39/serve-healthcheck-canary/0.log" Jun 11 23:55:26.462833 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:26.462797 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wn5bv_ce770529-f3b3-4a07-aaf6-e08b2b76f30d/kube-rbac-proxy/0.log" Jun 11 23:55:26.488252 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:26.488222 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wn5bv_ce770529-f3b3-4a07-aaf6-e08b2b76f30d/exporter/0.log" Jun 11 23:55:26.519292 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:26.519260 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wn5bv_ce770529-f3b3-4a07-aaf6-e08b2b76f30d/extractor/0.log" Jun 11 23:55:28.847605 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:28.847574 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d79f9cfb6-8bp49_84b058a0-6345-408a-ae2f-d750bb7dab38/nginx/0.log" Jun 11 23:55:28.895173 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:28.895145 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-q4g76_7de1a033-ad8c-4d43-aba4-a77f24024876/manager/0.log" Jun 11 23:55:28.976727 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:28.976692 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-jvdrc_5fe5b788-7938-48a2-a24d-48ba9d3a3dc2/manager/0.log" Jun 11 23:55:29.011078 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.011052 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fd589bf7-z9jrh_6945b19e-fef7-407d-aa34-ec4db297f730/maas-api/0.log" Jun 11 23:55:29.023740 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.023707 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-8m7wf" Jun 11 23:55:29.128415 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.128386 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59b4c8b45-sqcml_c018b4f4-833d-4735-9011-bd72c826b4b5/manager/0.log" Jun 11 23:55:29.149280 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.149255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6wsnc_e0f29d92-314f-4c72-bd3b-7ecaef321edb/server/0.log" Jun 11 23:55:29.203026 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.202993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ftq6j_c3858a7d-87b7-433c-9f52-1babb932ddf7/manager/0.log" Jun 11 23:55:29.382865 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.382770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-zkz7x_13656011-9fe5-472d-8129-1150e06d01a8/manager/0.log" Jun 11 23:55:29.403776 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:29.403750 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-zkz7x_13656011-9fe5-472d-8129-1150e06d01a8/copy-manifests/0.log" Jun 11 23:55:35.254176 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:35.254143 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gtmjx_63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0/discovery/0.log" Jun 11 23:55:35.279069 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:35.279040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-ghwpm_4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461/kube-auth-proxy/0.log" Jun 11 23:55:35.411838 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:35.411802 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-v2xft_2ce7e59b-1dad-4b89-b0b3-a52708740fc9/payload-processing/0.log" Jun 11 23:55:36.634129 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:36.634086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-x7288_7066b57b-97ee-497e-bcd5-c308ac9e05e8/migrator/0.log" Jun 11 23:55:36.637239 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:36.637217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gtmjx_63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0/discovery/0.log" Jun 11 23:55:36.660186 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:36.660158 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-x7288_7066b57b-97ee-497e-bcd5-c308ac9e05e8/graceful-termination/0.log" Jun 11 23:55:36.669735 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:36.669710 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-ghwpm_4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461/kube-auth-proxy/0.log" Jun 11 23:55:36.790903 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:36.790873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-v2xft_2ce7e59b-1dad-4b89-b0b3-a52708740fc9/payload-processing/0.log" Jun 11 23:55:38.452895 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.452865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/kube-multus-additional-cni-plugins/0.log" Jun 11 23:55:38.475896 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.475864 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/egress-router-binary-copy/0.log" Jun 11 23:55:38.500542 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.500515 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/cni-plugins/0.log" Jun 11 23:55:38.528062 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.528034 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/bond-cni-plugin/0.log" Jun 11 23:55:38.532905 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.532877 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gtmjx_63ae3fd8-a277-401b-b1a1-d33fe1f2b1f0/discovery/0.log" Jun 11 23:55:38.554699 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.554675 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/routeoverride-cni/0.log" Jun 11 23:55:38.557494 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.557474 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-ghwpm_4cf7b2ac-36fd-4fbe-8674-ee3d3e9d3461/kube-auth-proxy/0.log" Jun 11 23:55:38.576548 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.576521 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/whereabouts-cni-bincopy/0.log" Jun 11 23:55:38.626279 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.626236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k9kxr_17161d73-8451-4b27-8427-170033f90348/whereabouts-cni/0.log" Jun 11 23:55:38.686403 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.686376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-v2xft_2ce7e59b-1dad-4b89-b0b3-a52708740fc9/payload-processing/0.log" Jun 11 23:55:38.844127 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:38.844048 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bz7dl_1102fc10-c0a5-4f12-83fa-d70416c08ae1/kube-multus/0.log" Jun 11 23:55:39.015367 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:39.015336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qzdgl_446c6a64-0dd1-4c08-a064-e6a93dba48de/network-metrics-daemon/0.log" Jun 11 23:55:39.035704 ip-10-0-143-190 kubenswrapper[2581]: I0611 23:55:39.035680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qzdgl_446c6a64-0dd1-4c08-a064-e6a93dba48de/kube-rbac-proxy/0.log"