Jun 03 22:59:49.977886 ip-10-0-138-203 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 22:59:49.977900 ip-10-0-138-203 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 22:59:49.977910 ip-10-0-138-203 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 22:59:49.978151 ip-10-0-138-203 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 23:00:00.036596 ip-10-0-138-203 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 23:00:00.036620 ip-10-0-138-203 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e529ca26d0734462acd9f832951b2545 -- Jun 03 23:02:35.238991 ip-10-0-138-203 systemd[1]: Starting Kubernetes Kubelet... Jun 03 23:02:35.660858 ip-10-0-138-203 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:02:35.660858 ip-10-0-138-203 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 23:02:35.660858 ip-10-0-138-203 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:02:35.660858 ip-10-0-138-203 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 23:02:35.660858 ip-10-0-138-203 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:02:35.661930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.661840 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 23:02:35.666946 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666929 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:35.666946 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666945 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666949 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666952 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666956 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666959 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666964 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666968 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666971 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666975 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666978 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666981 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666984 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666996 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.666999 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667002 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667004 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667007 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667010 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667013 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667016 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:35.667010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667019 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667022 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667025 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667028 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667030 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667033 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667035 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667038 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667041 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667043 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667046 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667048 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667051 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667053 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667055 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667058 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667060 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667063 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667066 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667069 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:35.667495 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667071 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667074 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667078 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667081 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667084 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667087 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667090 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667093 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667098 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667101 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667104 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667107 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667109 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667112 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667115 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667118 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667120 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667123 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667125 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667128 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:35.668030 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667131 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667134 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667136 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667139 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667142 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667145 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667147 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667150 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667152 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667154 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667157 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667160 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667162 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667166 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667170 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667174 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667176 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667179 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:35.668514 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667182 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667185 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667187 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667191 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667193 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667196 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667199 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667202 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667205 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667207 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667210 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667212 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667215 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667217 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667220 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667222 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667225 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667227 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667229 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.667998 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:35.668979 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668005 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668009 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668012 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668015 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668018 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668021 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668024 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668027 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668029 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668032 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668035 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668041 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668046 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668050 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668053 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668057 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668061 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668064 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668067 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:35.669454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668070 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668073 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668075 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668078 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668081 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668084 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668087 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668090 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668093 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668096 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668099 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668101 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668104 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668106 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668111 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668113 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668116 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668119 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668126 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668129 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:35.669997 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668138 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668141 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668143 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668146 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668149 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668152 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668155 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668157 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668161 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668163 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668166 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668168 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668171 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668174 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668176 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668179 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668181 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668184 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668186 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:35.670519 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668189 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668191 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668194 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668196 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668200 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668203 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668205 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668208 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668210 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668213 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668215 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668218 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668220 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668222 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668226 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668228 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668231 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668233 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668236 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668239 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:35.671023 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668242 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668245 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668247 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668250 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668252 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668256 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668259 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668262 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668264 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668267 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668269 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668272 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668274 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668276 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668279 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668281 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668284 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668286 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668289 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:35.671516 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668690 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668696 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668699 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668703 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668706 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668709 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668711 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668715 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668718 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668721 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668724 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668726 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668729 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668733 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668735 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668738 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668740 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668744 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668746 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:35.671988 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668750 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668754 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668757 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668760 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668762 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668765 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668767 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668770 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668773 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668775 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668778 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668781 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668783 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668786 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668788 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668791 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668793 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668796 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668799 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668801 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:35.672454 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668804 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668807 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668810 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668812 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668819 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668821 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668824 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668826 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668829 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668832 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668834 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668838 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668842 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668845 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668848 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668850 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668853 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668855 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668858 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668861 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:35.672967 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668865 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668867 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668870 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668872 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668875 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668878 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668880 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668883 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668885 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668888 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668890 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668894 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668897 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668900 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668903 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668905 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668909 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668912 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668914 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668917 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:35.673466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668919 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668922 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668924 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668927 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668929 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668932 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668935 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668937 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668940 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668942 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668945 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668956 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668961 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668965 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668967 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668970 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668974 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668977 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.668980 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669046 2552 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 23:02:35.674012 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669053 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669059 2552 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669064 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669073 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669076 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669080 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669084 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669088 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669093 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669096 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669100 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669103 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669106 2552 flags.go:64] FLAG: --cgroup-root="" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669110 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669113 2552 flags.go:64] FLAG: --client-ca-file="" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669115 2552 flags.go:64] FLAG: --cloud-provider="external" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669118 2552 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669123 2552 flags.go:64] FLAG: --cluster-domain="" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669126 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669129 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669132 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669135 2552 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669139 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 23:02:35.674497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669142 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669145 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669149 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669152 2552 flags.go:64] FLAG: --contention-profiling="false" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669155 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669158 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669162 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669165 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669174 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669177 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669181 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669184 2552 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669188 2552 flags.go:64] FLAG: --enable-server="true" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669191 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669196 2552 flags.go:64] FLAG: --event-burst="100" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669199 2552 flags.go:64] FLAG: --event-qps="50" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669202 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669207 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669210 2552 flags.go:64] FLAG: --eviction-hard="" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669214 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669217 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669220 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669223 2552 flags.go:64] FLAG: --eviction-soft="" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669226 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669229 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 23:02:35.675092 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669231 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669235 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669238 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669241 2552 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669243 2552 flags.go:64] FLAG: --feature-gates="" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669247 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669250 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669253 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669256 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669260 2552 flags.go:64] FLAG: --healthz-port="10248" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669263 2552 flags.go:64] FLAG: --help="false" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669266 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669269 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669272 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669275 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669279 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669282 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669285 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669288 2552 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669292 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669295 2552 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669298 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669302 2552 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669304 2552 flags.go:64] FLAG: --kube-reserved="" Jun 03 23:02:35.675720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669309 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669316 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669320 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669322 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669325 2552 flags.go:64] FLAG: --lock-file="" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669328 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669331 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669334 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669340 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669343 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669345 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669348 2552 flags.go:64] FLAG: --logging-format="text" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669351 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669354 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669357 2552 flags.go:64] FLAG: --manifest-url="" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669360 2552 flags.go:64] FLAG: --manifest-url-header="" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669365 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669368 2552 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669372 2552 flags.go:64] FLAG: --max-pods="110" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669375 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669378 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669381 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669384 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669387 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669390 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 23:02:35.676338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669393 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669400 2552 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669404 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669407 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669410 2552 flags.go:64] FLAG: --pod-cidr="" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669413 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669419 2552 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669422 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669427 2552 flags.go:64] FLAG: --pods-per-core="0" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669431 2552 flags.go:64] FLAG: --port="10250" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669434 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669437 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-029f44e1ba144bd65" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669440 2552 flags.go:64] FLAG: --qos-reserved="" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669443 2552 flags.go:64] FLAG: --read-only-port="10255" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669446 2552 flags.go:64] FLAG: --register-node="true" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669449 2552 flags.go:64] FLAG: --register-with-taints="" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669452 2552 flags.go:64] FLAG: --registry-burst="10" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669455 2552 flags.go:64] FLAG: --registry-qps="5" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669458 2552 flags.go:64] FLAG: --reserved-cpus="" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669461 2552 flags.go:64] FLAG: --reserved-memory="" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669465 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669468 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669471 2552 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669474 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669477 2552 flags.go:64] FLAG: --runonce="false" Jun 03 23:02:35.677219 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669480 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669483 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669486 2552 flags.go:64] FLAG: --seccomp-default="false" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669489 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669492 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669495 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669498 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669501 2552 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669504 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669516 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669520 2552 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669523 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669526 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669529 2552 flags.go:64] FLAG: --system-cgroups="" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669532 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669539 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669542 2552 flags.go:64] FLAG: --tls-cert-file="" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669545 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669550 2552 flags.go:64] FLAG: --tls-min-version="" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669553 2552 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669555 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669558 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669561 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669565 2552 flags.go:64] FLAG: --v="2" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669569 2552 flags.go:64] FLAG: --version="false" Jun 03 23:02:35.678081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669573 2552 flags.go:64] FLAG: --vmodule="" Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669576 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669580 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669704 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669708 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669711 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669714 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669717 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669720 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669723 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669726 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669728 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669731 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669734 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669737 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669740 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669745 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669747 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669750 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669753 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:35.678815 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669755 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669758 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669762 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669765 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669768 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669771 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669774 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669776 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669780 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669784 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669787 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669790 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669793 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669795 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669798 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669801 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669804 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669806 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669809 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:35.679306 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669811 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669814 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669816 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669819 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669821 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669824 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669826 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669829 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669832 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669836 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669838 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669841 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669843 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669846 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669848 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669852 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669855 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669858 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669860 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669863 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:35.679808 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669866 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669869 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669873 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669876 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669879 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669882 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669885 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669887 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669890 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669893 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669895 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669898 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669900 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669903 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669905 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669908 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669911 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669913 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669916 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669918 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:35.680311 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669921 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669925 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669929 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669932 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669935 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669938 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669941 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669945 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669947 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669950 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669953 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669956 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669960 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669963 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669966 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669969 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669971 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669974 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669976 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:35.680814 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669979 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669982 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.669984 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.669990 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.678228 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.678244 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.678265 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.678271 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678332 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678337 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678341 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678344 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678347 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678350 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678353 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:35.681285 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678356 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678359 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678362 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678364 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678367 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678370 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678373 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678376 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678379 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678382 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678385 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678388 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678390 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678393 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678395 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678398 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678401 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678404 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678407 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678410 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:35.681674 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678412 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678416 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678419 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678422 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678425 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678429 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678433 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678436 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678439 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678442 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678445 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678448 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678451 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678454 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678457 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678460 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678462 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678465 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678468 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:35.682164 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678471 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678473 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678476 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678479 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678481 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678484 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678486 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678489 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678492 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678495 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678497 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678500 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678502 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678505 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678508 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678511 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678514 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678517 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678519 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:35.682724 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678523 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678527 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678530 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678533 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678536 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678539 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678542 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678544 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678547 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678550 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678553 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678556 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678559 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678562 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678566 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678569 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678572 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678575 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678577 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678580 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:35.683191 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678583 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678585 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678588 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678590 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678593 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678595 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678598 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678601 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678604 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678608 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678612 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678615 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678618 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.678623 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678760 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:35.683792 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678766 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678769 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678772 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678775 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678778 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678780 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678783 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678785 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678788 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678791 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678794 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678796 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678800 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678803 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678805 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678808 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678811 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678813 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678816 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678819 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:35.684205 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678822 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678825 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678827 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678830 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678833 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678837 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678840 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678842 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678845 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678847 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678850 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678852 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678855 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678858 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678860 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678863 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678865 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678868 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678870 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678875 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:35.684723 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678878 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678881 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678884 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678887 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678890 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678893 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678896 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678899 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678902 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678906 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678909 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678912 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678915 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678918 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678921 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678923 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678926 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678930 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678932 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678935 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:35.685542 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678938 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678940 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678943 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678945 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678948 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678950 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678953 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678955 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678958 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678961 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678963 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678966 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678968 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678972 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678974 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678977 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678979 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678982 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678985 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678988 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:35.686070 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678990 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678993 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678996 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.678998 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679001 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679004 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679007 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679010 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679013 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679016 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679019 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679021 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679024 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679026 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679029 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679031 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:35.686580 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:35.679034 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.679039 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.679168 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.682136 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.683622 2552 server.go:1019] "Starting client certificate rotation" Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.683698 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.683751 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:02:35.686984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.686354 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:02:35.687543 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.687514 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:02:35.699634 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.699611 2552 log.go:25] "Validated CRI v1 runtime API" Jun 03 23:02:35.705147 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.705127 2552 log.go:25] "Validated CRI v1 image API" Jun 03 23:02:35.706014 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.705998 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 23:02:35.708429 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.708406 2552 fs.go:135] Filesystem UUIDs: map[24bedb71-a01b-4545-becd-de44a89f67b5:/dev/nvme0n1p4 5dec9d1a-4972-4d01-87d0-b89127c51514:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 03 23:02:35.708503 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.708427 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 23:02:35.714427 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.714307 2552 manager.go:216] Machine: {Timestamp:2026-06-03 23:02:35.713809024 +0000 UTC m=+0.351901764 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104142 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29494b84e9af47be773d8b8f8e9c52 SystemUUID:ec29494b-84e9-af47-be77-3d8b8f8e9c52 BootID:e529ca26-d073-4462-acd9-f832951b2545 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:1e:7f:2b:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:1e:7f:2b:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:96:c6:e1:90:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 23:02:35.714427 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.714411 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 23:02:35.714576 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.714521 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 23:02:35.717618 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.717584 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 23:02:35.717804 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.717623 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 23:02:35.718360 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.718347 2552 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 23:02:35.718413 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.718367 2552 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 23:02:35.718413 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.718378 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:02:35.719077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.719064 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:02:35.719132 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.719062 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:02:35.719994 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.719981 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 23:02:35.723027 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723013 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:02:35.723320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723309 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 23:02:35.723363 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723344 2552 kubelet.go:486] "Attempting to sync node with API server" Jun 03 23:02:35.723363 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723356 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 23:02:35.723430 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723370 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 23:02:35.723430 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723381 2552 kubelet.go:398] "Adding apiserver pod source" Jun 03 23:02:35.723430 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.723391 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 23:02:35.724592 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.724571 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:02:35.724687 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.724602 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:02:35.727208 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.727185 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 23:02:35.729006 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.728993 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 23:02:35.729056 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.729022 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 23:02:35.730237 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730225 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730241 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730247 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730253 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730262 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730267 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730275 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 23:02:35.730282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730280 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 23:02:35.730469 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730287 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 23:02:35.730469 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730293 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 23:02:35.730469 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730301 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 23:02:35.730469 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.730306 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 23:02:35.731105 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.731096 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 23:02:35.731105 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.731105 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 23:02:35.734751 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.734735 2552 server.go:1268] "Started kubelet" Jun 03 23:02:35.734904 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.734851 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 23:02:35.734970 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.734905 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 23:02:35.734970 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.734928 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 23:02:35.735064 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.735017 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 23:02:35.735117 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.735077 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 23:02:35.735488 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.735458 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 23:02:35.735762 ip-10-0-138-203 systemd[1]: Started Kubernetes Kubelet. Jun 03 23:02:35.737296 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.737277 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 23:02:35.737816 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.737804 2552 server.go:310] "Adding debug handlers to kubelet server" Jun 03 23:02:35.741878 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.741859 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 23:02:35.742482 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.742470 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 23:02:35.742540 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.742524 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 23:02:35.742585 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.742544 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:35.743138 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743123 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 23:02:35.743230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743142 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 23:02:35.743230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743158 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 23:02:35.743337 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743321 2552 reconstruct.go:97] "Volume reconstruction finished" Jun 03 23:02:35.743337 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743331 2552 reconciler.go:29] "Reconciler: start to sync state" Jun 03 23:02:35.743424 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743411 2552 factory.go:55] Registering systemd factory Jun 03 23:02:35.743467 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743446 2552 factory.go:223] Registration of the systemd container factory successfully Jun 03 23:02:35.743721 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743705 2552 factory.go:153] Registering CRI-O factory Jun 03 23:02:35.743721 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743721 2552 factory.go:223] Registration of the crio container factory successfully Jun 03 23:02:35.743846 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743763 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 23:02:35.743846 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743781 2552 factory.go:103] Registering Raw factory Jun 03 23:02:35.743846 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.743791 2552 manager.go:1196] Started watching for new ooms in manager Jun 03 23:02:35.743994 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.742874 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-203.ec2.internal.18b5b48f694a84dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-203.ec2.internal,UID:ip-10-0-138-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-203.ec2.internal,},FirstTimestamp:2026-06-03 23:02:35.734713565 +0000 UTC m=+0.372806305,LastTimestamp:2026-06-03 23:02:35.734713565 +0000 UTC m=+0.372806305,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-203.ec2.internal,}" Jun 03 23:02:35.744143 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.744132 2552 manager.go:349] Starting recovery of all containers Jun 03 23:02:35.751811 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.751765 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 23:02:35.752199 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.752145 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 23:02:35.754591 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.754555 2552 manager.go:354] Recovery completed Jun 03 23:02:35.760417 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.760403 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.764525 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.764506 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.764605 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.764538 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.764605 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.764549 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.765079 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.765066 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 23:02:35.765079 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.765079 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 23:02:35.765188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.765096 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:02:35.765188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.765124 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.766406 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.766393 2552 policy_none.go:49] "None policy: Start" Jun 03 23:02:35.766483 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.766412 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 23:02:35.766483 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.766425 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 23:02:35.766860 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.766844 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.766942 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.766870 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.766942 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.766884 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.767051 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.766957 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-203.ec2.internal.18b5b48f6b1162af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-203.ec2.internal,UID:ip-10-0-138-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-203.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-203.ec2.internal,},FirstTimestamp:2026-06-03 23:02:35.764523695 +0000 UTC m=+0.402616436,LastTimestamp:2026-06-03 23:02:35.764523695 +0000 UTC m=+0.402616436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-203.ec2.internal,}" Jun 03 23:02:35.767755 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.767740 2552 policy_none.go:47] "Start" Jun 03 23:02:35.767920 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.767906 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9q46z" Jun 03 23:02:35.776337 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.776321 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9q46z" Jun 03 23:02:35.777046 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.776983 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-203.ec2.internal.18b5b48f6b11b059 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-203.ec2.internal,UID:ip-10-0-138-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-203.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-203.ec2.internal,},FirstTimestamp:2026-06-03 23:02:35.764543577 +0000 UTC m=+0.402636316,LastTimestamp:2026-06-03 23:02:35.764543577 +0000 UTC m=+0.402636316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-203.ec2.internal,}" Jun 03 23:02:35.803283 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803263 2552 manager.go:337] "Starting Device Plugin manager" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.803299 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803312 2552 server.go:87] "Starting device plugin registration server" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803616 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803629 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803757 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803831 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.803840 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.804421 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.804468 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.811805 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.812974 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.813009 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.813029 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 23:02:35.815277 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.813064 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 23:02:35.815748 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.815568 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:35.904645 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.904607 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.905599 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.905579 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.905715 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.905611 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.905715 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.905621 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.905715 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.905643 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.913483 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.913434 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal"] Jun 03 23:02:35.913532 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.913499 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.915079 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.915064 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.915131 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.915095 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.915131 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.915120 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.916716 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.916700 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.916788 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.916708 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.916849 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.916810 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-203.ec2.internal\": node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:35.916907 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.916778 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.916907 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.916884 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.917421 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.917404 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.917472 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.917409 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.917472 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.917459 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.917560 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.917480 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.917560 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.917439 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.917560 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.917521 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.918693 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.918679 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.918762 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.918707 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:35.919346 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.919334 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:35.919421 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.919357 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:35.919421 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.919370 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:35.942422 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.942390 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:35.942557 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.942541 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-203.ec2.internal\" not found" node="ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.943559 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.943540 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a52e9921bc0b2ecdffb8b18fe74b17e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal\" (UID: \"8a52e9921bc0b2ecdffb8b18fe74b17e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.943686 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.943573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a52e9921bc0b2ecdffb8b18fe74b17e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal\" (UID: \"8a52e9921bc0b2ecdffb8b18fe74b17e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.943686 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:35.943592 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9af29b3c0ed1e2d0969b0e864a816d25-config\") pod \"kube-apiserver-proxy-ip-10-0-138-203.ec2.internal\" (UID: \"9af29b3c0ed1e2d0969b0e864a816d25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" Jun 03 23:02:35.947185 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:35.947168 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-203.ec2.internal\" not found" node="ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.043420 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.043384 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.044126 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.044105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9af29b3c0ed1e2d0969b0e864a816d25-config\") pod \"kube-apiserver-proxy-ip-10-0-138-203.ec2.internal\" (UID: \"9af29b3c0ed1e2d0969b0e864a816d25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.044241 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.044131 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a52e9921bc0b2ecdffb8b18fe74b17e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal\" (UID: \"8a52e9921bc0b2ecdffb8b18fe74b17e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.044241 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.044149 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a52e9921bc0b2ecdffb8b18fe74b17e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal\" (UID: \"8a52e9921bc0b2ecdffb8b18fe74b17e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.044241 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.044175 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a52e9921bc0b2ecdffb8b18fe74b17e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal\" (UID: \"8a52e9921bc0b2ecdffb8b18fe74b17e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.044241 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.044194 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9af29b3c0ed1e2d0969b0e864a816d25-config\") pod \"kube-apiserver-proxy-ip-10-0-138-203.ec2.internal\" (UID: \"9af29b3c0ed1e2d0969b0e864a816d25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.044241 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.044219 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a52e9921bc0b2ecdffb8b18fe74b17e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal\" (UID: \"8a52e9921bc0b2ecdffb8b18fe74b17e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.144066 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.144020 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.244764 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.244694 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.245795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.245782 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.251528 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.251506 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.345727 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.345687 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.446187 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.446158 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.546684 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.546588 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.647102 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.647072 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-203.ec2.internal\" not found" Jun 03 23:02:36.683332 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.683298 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 23:02:36.684113 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.683468 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:02:36.696172 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.696145 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:36.723816 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.723787 2552 apiserver.go:52] "Watching apiserver" Jun 03 23:02:36.734581 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.734553 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 23:02:36.734930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.734908 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-cqq5c","openshift-dns/node-resolver-rccsq","openshift-image-registry/node-ca-fw9vj","openshift-multus/network-metrics-daemon-6l7xg","openshift-network-diagnostics/network-check-target-rgfjc","openshift-network-operator/iptables-alerter-v255j","openshift-ovn-kubernetes/ovnkube-node-kdpr7","kube-system/konnectivity-agent-p7r47","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt","openshift-multus/multus-additional-cni-plugins-wjj52","openshift-multus/multus-z47gz","kube-system/global-pull-secret-syncer-z4ld4"] Jun 03 23:02:36.736870 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.736849 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.739563 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.739301 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.739563 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.739378 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.739736 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.739608 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mwr7j\"" Jun 03 23:02:36.740340 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.740317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:36.740452 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.740386 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:36.741805 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.741790 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.743009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.742991 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.743086 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.742996 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 23:02:36.743301 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.743270 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.743738 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.743719 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.743867 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.743738 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.743867 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.743723 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h8j6s\"" Jun 03 23:02:36.744837 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.744819 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:36.744935 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.744882 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:36.745949 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.745923 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 23:02:36.746031 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.745936 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.746031 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.746022 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.746171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.746023 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-drfxj\"" Jun 03 23:02:36.746485 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.746471 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.747914 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.747897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.748231 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748209 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4947f5bc-89b0-4d81-be6d-981aaef111fc-serviceca\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.748371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:36.748371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748259 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-modprobe-d\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysconfig\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-kubernetes\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748347 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysctl-conf\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-sys\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748412 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp8z8\" (UniqueName: \"kubernetes.io/projected/4947f5bc-89b0-4d81-be6d-981aaef111fc-kube-api-access-zp8z8\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748434 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgwnt\" (UniqueName: \"kubernetes.io/projected/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-kube-api-access-hgwnt\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748461 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysctl-d\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-systemd\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748517 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-run\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748544 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-host\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zvhn\" (UniqueName: \"kubernetes.io/projected/2309d492-8f1a-491e-a53d-171b78b62edc-kube-api-access-6zvhn\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748586 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748604 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748631 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-hosts-file\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.748681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-var-lib-kubelet\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2309d492-8f1a-491e-a53d-171b78b62edc-etc-tuned\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748694 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748746 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lmh9\" (UniqueName: \"kubernetes.io/projected/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-kube-api-access-2lmh9\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748794 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wzxmp\"" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748799 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-tmp-dir\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748824 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-lib-modules\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2309d492-8f1a-491e-a53d-171b78b62edc-tmp\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.748899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4947f5bc-89b0-4d81-be6d-981aaef111fc-host\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.749230 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.749037 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.749910 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.749476 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.749910 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.749781 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 23:02:36.749910 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.749856 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 23:02:36.751045 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.751017 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 23:02:36.751045 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.751017 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.751245 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.751060 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.752257 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.752236 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.752859 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.752830 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 23:02:36.752960 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.752861 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 23:02:36.752960 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.752903 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 23:02:36.752960 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.752943 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x6lf8\"" Jun 03 23:02:36.753107 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.753023 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7nfr7\"" Jun 03 23:02:36.753901 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.753884 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.754298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.754088 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bblxh\"" Jun 03 23:02:36.754298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.754119 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 23:02:36.754469 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.754453 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.754721 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.754703 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.755436 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.755421 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.755803 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.755787 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 23:02:36.755891 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.755879 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 23:02:36.756001 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.755987 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 23:02:36.756122 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.756103 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rsrmr\"" Jun 03 23:02:36.756198 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.756185 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 23:02:36.756262 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.756211 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 23:02:36.756419 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.756397 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:02:36.757381 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.757353 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 23:02:36.757471 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.757411 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q9bjb\"" Jun 03 23:02:36.757703 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.757687 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.757780 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.757737 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:36.762785 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.762765 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:02:36.762878 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.762800 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal"] Jun 03 23:02:36.762878 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.762843 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" Jun 03 23:02:36.768874 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.768854 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal"] Jun 03 23:02:36.768966 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.768918 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:02:36.779313 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.779265 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 22:57:35 +0000 UTC" deadline="2028-02-19 04:58:55.864816276 +0000 UTC" Jun 03 23:02:36.779313 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.779311 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15005h56m19.085507607s" Jun 03 23:02:36.779549 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.779536 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lspj" Jun 03 23:02:36.781957 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:36.781925 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af29b3c0ed1e2d0969b0e864a816d25.slice/crio-573ed0de7d84be54ca91cd1c0d0bf1c9618c44ee581a7a6ab87ad4a469e094ce WatchSource:0}: Error finding container 573ed0de7d84be54ca91cd1c0d0bf1c9618c44ee581a7a6ab87ad4a469e094ce: Status 404 returned error can't find the container with id 573ed0de7d84be54ca91cd1c0d0bf1c9618c44ee581a7a6ab87ad4a469e094ce Jun 03 23:02:36.782207 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:36.782189 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a52e9921bc0b2ecdffb8b18fe74b17e.slice/crio-e4b58e841a3415c7809eaf0e40fb1ffdc4612d723a9376f2fdff2316d09d6f41 WatchSource:0}: Error finding container e4b58e841a3415c7809eaf0e40fb1ffdc4612d723a9376f2fdff2316d09d6f41: Status 404 returned error can't find the container with id e4b58e841a3415c7809eaf0e40fb1ffdc4612d723a9376f2fdff2316d09d6f41 Jun 03 23:02:36.787013 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.786996 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:02:36.787973 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.787954 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lspj" Jun 03 23:02:36.806748 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.806727 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:36.816937 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.816886 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" event={"ID":"8a52e9921bc0b2ecdffb8b18fe74b17e","Type":"ContainerStarted","Data":"e4b58e841a3415c7809eaf0e40fb1ffdc4612d723a9376f2fdff2316d09d6f41"} Jun 03 23:02:36.817921 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.817900 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" event={"ID":"9af29b3c0ed1e2d0969b0e864a816d25","Type":"ContainerStarted","Data":"573ed0de7d84be54ca91cd1c0d0bf1c9618c44ee581a7a6ab87ad4a469e094ce"} Jun 03 23:02:36.844343 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.844310 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 23:02:36.849101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849075 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-lib-modules\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.849240 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849107 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4947f5bc-89b0-4d81-be6d-981aaef111fc-host\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.849240 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849124 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4947f5bc-89b0-4d81-be6d-981aaef111fc-serviceca\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.849240 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-cni-multus\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.849240 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849206 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4947f5bc-89b0-4d81-be6d-981aaef111fc-host\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.849240 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849219 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-cni-bin\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849268 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-lib-modules\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849318 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovn-node-metrics-cert\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-sys\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849413 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwnt\" (UniqueName: \"kubernetes.io/projected/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-kube-api-access-hgwnt\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysctl-d\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.849484 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zvhn\" (UniqueName: \"kubernetes.io/projected/2309d492-8f1a-491e-a53d-171b78b62edc-kube-api-access-6zvhn\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849485 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-os-release\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849508 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-socket-dir-parent\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849532 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-systemd-units\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849588 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysctl-d\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-etc-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-os-release\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4947f5bc-89b0-4d81-be6d-981aaef111fc-serviceca\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849720 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-cni-bin\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849756 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-node-log\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849777 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-registration-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.849795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-sys\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-netns\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-systemd\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849852 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-cni-netd\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849917 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-host-slash\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.849962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp8z8\" (UniqueName: \"kubernetes.io/projected/4947f5bc-89b0-4d81-be6d-981aaef111fc-kube-api-access-zp8z8\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-iptables-alerter-script\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-cni-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850055 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d71ee51b-4b7e-43db-b863-8fef4edf3c04-kubelet-config\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzfwk\" (UniqueName: \"kubernetes.io/projected/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-kube-api-access-tzfwk\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850094 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-system-cni-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-k8s-cni-cncf-io\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850123 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-etc-kubernetes\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850136 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-run-netns\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-hosts-file\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-var-lib-kubelet\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.850285 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850228 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-hosts-file\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850241 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2309d492-8f1a-491e-a53d-171b78b62edc-etc-tuned\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850264 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-system-cni-dir\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850286 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-cnibin\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850304 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-tmp-dir\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850313 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-var-lib-kubelet\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850341 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11117f0e-3040-496c-99d7-8b958ff3ae22-konnectivity-ca\") pod \"konnectivity-agent-p7r47\" (UID: \"11117f0e-3040-496c-99d7-8b958ff3ae22\") " pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850356 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-hostroot\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850370 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4khfj\" (UniqueName: \"kubernetes.io/projected/16d90566-5c58-4f68-9f2a-03b15a95a75e-kube-api-access-4khfj\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcrfb\" (UniqueName: \"kubernetes.io/projected/55099152-e89d-4922-85b8-42c1469d3c30-kube-api-access-pcrfb\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850439 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-modprobe-d\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850476 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-daemon-config\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850508 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-multus-certs\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850541 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d71ee51b-4b7e-43db-b863-8fef4edf3c04-dbus\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850550 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-modprobe-d\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-ovn\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.851028 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850598 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovnkube-script-lib\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850609 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-tmp-dir\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850618 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-cni-binary-copy\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-systemd\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850665 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-run\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850685 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-systemd\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850697 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-run\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850696 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-host\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11117f0e-3040-496c-99d7-8b958ff3ae22-agent-certs\") pod \"konnectivity-agent-p7r47\" (UID: \"11117f0e-3040-496c-99d7-8b958ff3ae22\") " pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850737 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-host\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850741 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-var-lib-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850773 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-kubelet\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850819 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-log-socket\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850838 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2309d492-8f1a-491e-a53d-171b78b62edc-tmp\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850877 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16d90566-5c58-4f68-9f2a-03b15a95a75e-cni-binary-copy\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850895 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.851713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850928 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-socket-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850944 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850960 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-slash\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850977 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.850992 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysconfig\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851007 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-kubernetes\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851021 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysctl-conf\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-device-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851052 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-sys-fs\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851070 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysconfig\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851077 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851094 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-kubernetes\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851098 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-cnibin\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851114 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851141 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-kubelet\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-env-overrides\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.851171 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:36.852188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851217 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkvv7\" (UniqueName: \"kubernetes.io/projected/a9e42b86-17da-4a57-a0c8-26fd865f1ded-kube-api-access-pkvv7\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851176 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2309d492-8f1a-491e-a53d-171b78b62edc-etc-sysctl-conf\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.851254 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:02:37.35122782 +0000 UTC m=+1.989320569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851307 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lmh9\" (UniqueName: \"kubernetes.io/projected/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-kube-api-access-2lmh9\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851333 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-conf-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851376 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovnkube-config\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.852710 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.851424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xknl\" (UniqueName: \"kubernetes.io/projected/160907c7-062b-4de8-8e44-830da2bfc0ed-kube-api-access-7xknl\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.853874 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.853857 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2309d492-8f1a-491e-a53d-171b78b62edc-etc-tuned\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.853951 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.853901 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2309d492-8f1a-491e-a53d-171b78b62edc-tmp\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.860618 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.860598 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:36.860739 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.860620 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:36.860739 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.860636 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:36.860739 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.860725 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:37.360702072 +0000 UTC m=+1.998794820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:36.861938 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.861913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwnt\" (UniqueName: \"kubernetes.io/projected/d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3-kube-api-access-hgwnt\") pod \"node-resolver-rccsq\" (UID: \"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3\") " pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:36.862713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.862693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zvhn\" (UniqueName: \"kubernetes.io/projected/2309d492-8f1a-491e-a53d-171b78b62edc-kube-api-access-6zvhn\") pod \"tuned-cqq5c\" (UID: \"2309d492-8f1a-491e-a53d-171b78b62edc\") " pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:36.862989 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.862971 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lmh9\" (UniqueName: \"kubernetes.io/projected/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-kube-api-access-2lmh9\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:36.863214 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.863200 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp8z8\" (UniqueName: \"kubernetes.io/projected/4947f5bc-89b0-4d81-be6d-981aaef111fc-kube-api-access-zp8z8\") pod \"node-ca-fw9vj\" (UID: \"4947f5bc-89b0-4d81-be6d-981aaef111fc\") " pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:36.952528 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952491 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-cni-bin\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.952528 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-node-log\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952548 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-registration-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952567 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-netns\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952590 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-systemd\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-cni-netd\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952618 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-node-log\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952604 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-cni-bin\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952663 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-netns\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952674 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-registration-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-systemd\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952679 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952717 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952730 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-host-slash\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952743 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-cni-netd\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-iptables-alerter-script\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.952789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952794 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-host-slash\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952791 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-cni-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952831 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d71ee51b-4b7e-43db-b863-8fef4edf3c04-kubelet-config\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-cni-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952847 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfwk\" (UniqueName: \"kubernetes.io/projected/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-kube-api-access-tzfwk\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952863 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-system-cni-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952877 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-k8s-cni-cncf-io\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952893 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-etc-kubernetes\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952908 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-run-netns\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952905 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d71ee51b-4b7e-43db-b863-8fef4edf3c04-kubelet-config\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952949 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-system-cni-dir\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952957 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-k8s-cni-cncf-io\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952982 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-cnibin\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952995 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-etc-kubernetes\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952982 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-run-netns\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11117f0e-3040-496c-99d7-8b958ff3ae22-konnectivity-ca\") pod \"konnectivity-agent-p7r47\" (UID: \"11117f0e-3040-496c-99d7-8b958ff3ae22\") " pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953018 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-cnibin\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953002 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-system-cni-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.953410 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.952982 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-system-cni-dir\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-hostroot\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953086 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4khfj\" (UniqueName: \"kubernetes.io/projected/16d90566-5c58-4f68-9f2a-03b15a95a75e-kube-api-access-4khfj\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953120 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-hostroot\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953127 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcrfb\" (UniqueName: \"kubernetes.io/projected/55099152-e89d-4922-85b8-42c1469d3c30-kube-api-access-pcrfb\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-daemon-config\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953207 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-multus-certs\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953224 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d71ee51b-4b7e-43db-b863-8fef4edf3c04-dbus\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953249 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-ovn\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953270 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-run-multus-certs\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953293 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d71ee51b-4b7e-43db-b863-8fef4edf3c04-dbus\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovnkube-script-lib\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953339 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-cni-binary-copy\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953364 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-iptables-alerter-script\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953367 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11117f0e-3040-496c-99d7-8b958ff3ae22-agent-certs\") pod \"konnectivity-agent-p7r47\" (UID: \"11117f0e-3040-496c-99d7-8b958ff3ae22\") " pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953408 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-var-lib-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953453 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-kubelet\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-log-socket\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953528 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16d90566-5c58-4f68-9f2a-03b15a95a75e-cni-binary-copy\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953575 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953597 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-socket-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953621 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953645 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-slash\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-ovn\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-device-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953731 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-sys-fs\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953756 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-cnibin\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-kubelet\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953787 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-env-overrides\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953816 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkvv7\" (UniqueName: \"kubernetes.io/projected/a9e42b86-17da-4a57-a0c8-26fd865f1ded-kube-api-access-pkvv7\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.954730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-conf-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953866 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovnkube-config\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953900 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xknl\" (UniqueName: \"kubernetes.io/projected/160907c7-062b-4de8-8e44-830da2bfc0ed-kube-api-access-7xknl\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953927 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-cni-multus\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-cni-bin\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-device-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953959 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovn-node-metrics-cert\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953973 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovnkube-script-lib\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954002 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954039 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-os-release\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954045 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-kubelet\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954068 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-socket-dir-parent\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954095 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-systemd-units\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954125 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-etc-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954137 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.955320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954141 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16d90566-5c58-4f68-9f2a-03b15a95a75e-cni-binary-copy\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-os-release\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954170 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-log-socket\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954189 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-slash\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.953901 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.953832 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-socket-dir\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954238 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-sys-fs\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954277 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-cni-multus\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-cnibin\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11117f0e-3040-496c-99d7-8b958ff3ae22-konnectivity-ca\") pod \"konnectivity-agent-p7r47\" (UID: \"11117f0e-3040-496c-99d7-8b958ff3ae22\") " pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954312 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-etc-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954345 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55099152-e89d-4922-85b8-42c1469d3c30-os-release\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954092 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-var-lib-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954365 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-run-openvswitch\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954438 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-conf-dir\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954467 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.955834 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:36.954496 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:37.454476666 +0000 UTC m=+2.092569394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954500 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-os-release\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954619 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-cni-binary-copy\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-host-cni-bin\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954735 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-socket-dir-parent\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954771 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9e42b86-17da-4a57-a0c8-26fd865f1ded-systemd-units\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954806 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16d90566-5c58-4f68-9f2a-03b15a95a75e-host-var-lib-kubelet\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954816 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/16d90566-5c58-4f68-9f2a-03b15a95a75e-multus-daemon-config\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/160907c7-062b-4de8-8e44-830da2bfc0ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.954933 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-env-overrides\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.955125 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovnkube-config\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.956298 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.955202 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55099152-e89d-4922-85b8-42c1469d3c30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.956637 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.956589 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11117f0e-3040-496c-99d7-8b958ff3ae22-agent-certs\") pod \"konnectivity-agent-p7r47\" (UID: \"11117f0e-3040-496c-99d7-8b958ff3ae22\") " pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:36.956637 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.956600 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9e42b86-17da-4a57-a0c8-26fd865f1ded-ovn-node-metrics-cert\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.965746 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.965719 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfwk\" (UniqueName: \"kubernetes.io/projected/37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f-kube-api-access-tzfwk\") pod \"iptables-alerter-v255j\" (UID: \"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f\") " pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:36.966225 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.966196 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4khfj\" (UniqueName: \"kubernetes.io/projected/16d90566-5c58-4f68-9f2a-03b15a95a75e-kube-api-access-4khfj\") pod \"multus-z47gz\" (UID: \"16d90566-5c58-4f68-9f2a-03b15a95a75e\") " pod="openshift-multus/multus-z47gz" Jun 03 23:02:36.967435 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.967409 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcrfb\" (UniqueName: \"kubernetes.io/projected/55099152-e89d-4922-85b8-42c1469d3c30-kube-api-access-pcrfb\") pod \"multus-additional-cni-plugins-wjj52\" (UID: \"55099152-e89d-4922-85b8-42c1469d3c30\") " pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:36.967775 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.967759 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkvv7\" (UniqueName: \"kubernetes.io/projected/a9e42b86-17da-4a57-a0c8-26fd865f1ded-kube-api-access-pkvv7\") pod \"ovnkube-node-kdpr7\" (UID: \"a9e42b86-17da-4a57-a0c8-26fd865f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:36.967957 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:36.967942 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xknl\" (UniqueName: \"kubernetes.io/projected/160907c7-062b-4de8-8e44-830da2bfc0ed-kube-api-access-7xknl\") pod \"aws-ebs-csi-driver-node-jgrlt\" (UID: \"160907c7-062b-4de8-8e44-830da2bfc0ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:37.061587 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.061511 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rccsq" Jun 03 23:02:37.071075 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.071045 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c9433a_4cd9_40d7_8c51_5bf5f211b2c3.slice/crio-1073969d10f97ecc8105339a9c984e3452c9e9f588ed2d4f8c4dbfc272bbcfb6 WatchSource:0}: Error finding container 1073969d10f97ecc8105339a9c984e3452c9e9f588ed2d4f8c4dbfc272bbcfb6: Status 404 returned error can't find the container with id 1073969d10f97ecc8105339a9c984e3452c9e9f588ed2d4f8c4dbfc272bbcfb6 Jun 03 23:02:37.083182 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.083159 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" Jun 03 23:02:37.091233 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.091164 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fw9vj" Jun 03 23:02:37.092716 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.092685 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2309d492_8f1a_491e_a53d_171b78b62edc.slice/crio-b6679d313be372194b363bbc282fa1dbf2eff2146f832b1522d454f7a0e0ba93 WatchSource:0}: Error finding container b6679d313be372194b363bbc282fa1dbf2eff2146f832b1522d454f7a0e0ba93: Status 404 returned error can't find the container with id b6679d313be372194b363bbc282fa1dbf2eff2146f832b1522d454f7a0e0ba93 Jun 03 23:02:37.096064 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.096047 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v255j" Jun 03 23:02:37.099229 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.099205 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4947f5bc_89b0_4d81_be6d_981aaef111fc.slice/crio-95c318180e61a8ab47e7d77121d88def86801bc37047b3ffb67c81b7ac9964db WatchSource:0}: Error finding container 95c318180e61a8ab47e7d77121d88def86801bc37047b3ffb67c81b7ac9964db: Status 404 returned error can't find the container with id 95c318180e61a8ab47e7d77121d88def86801bc37047b3ffb67c81b7ac9964db Jun 03 23:02:37.102673 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.102635 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:02:37.104472 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.104448 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a1b2ab_303f_4dc9_8e92_c2d4d0a6458f.slice/crio-beed20283ae39b8ad744dacc3afccc8bb7f27d91c2115097f7163a885d713f3f WatchSource:0}: Error finding container beed20283ae39b8ad744dacc3afccc8bb7f27d91c2115097f7163a885d713f3f: Status 404 returned error can't find the container with id beed20283ae39b8ad744dacc3afccc8bb7f27d91c2115097f7163a885d713f3f Jun 03 23:02:37.107499 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.107482 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:02:37.110202 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.110178 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e42b86_17da_4a57_a0c8_26fd865f1ded.slice/crio-69a1212200d90657ad73b324d13000ec44c38ef3a851aff8fe878b2773021e9d WatchSource:0}: Error finding container 69a1212200d90657ad73b324d13000ec44c38ef3a851aff8fe878b2773021e9d: Status 404 returned error can't find the container with id 69a1212200d90657ad73b324d13000ec44c38ef3a851aff8fe878b2773021e9d Jun 03 23:02:37.113740 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.113667 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" Jun 03 23:02:37.115024 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.114991 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11117f0e_3040_496c_99d7_8b958ff3ae22.slice/crio-6e6f97b8a75e3386e389c9b8c594598a81f76804b5cad7174fef55b4982f6c7d WatchSource:0}: Error finding container 6e6f97b8a75e3386e389c9b8c594598a81f76804b5cad7174fef55b4982f6c7d: Status 404 returned error can't find the container with id 6e6f97b8a75e3386e389c9b8c594598a81f76804b5cad7174fef55b4982f6c7d Jun 03 23:02:37.118735 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.118705 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wjj52" Jun 03 23:02:37.122453 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.122430 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160907c7_062b_4de8_8e44_830da2bfc0ed.slice/crio-bb575e9437f55835ed4cc7177afe783549a0bd3b05f8ac06954b478ea545cf04 WatchSource:0}: Error finding container bb575e9437f55835ed4cc7177afe783549a0bd3b05f8ac06954b478ea545cf04: Status 404 returned error can't find the container with id bb575e9437f55835ed4cc7177afe783549a0bd3b05f8ac06954b478ea545cf04 Jun 03 23:02:37.125400 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.125359 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z47gz" Jun 03 23:02:37.128344 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.128319 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55099152_e89d_4922_85b8_42c1469d3c30.slice/crio-d421898ef97736e4f52d0d66ceb719fa9b3459f6574e1801840834f20f830776 WatchSource:0}: Error finding container d421898ef97736e4f52d0d66ceb719fa9b3459f6574e1801840834f20f830776: Status 404 returned error can't find the container with id d421898ef97736e4f52d0d66ceb719fa9b3459f6574e1801840834f20f830776 Jun 03 23:02:37.133774 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:02:37.133749 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d90566_5c58_4f68_9f2a_03b15a95a75e.slice/crio-bf884bcc604d5b7ba0af2b47446e7c8c39464d5a8600fb6e5710d80aa5850869 WatchSource:0}: Error finding container bf884bcc604d5b7ba0af2b47446e7c8c39464d5a8600fb6e5710d80aa5850869: Status 404 returned error can't find the container with id bf884bcc604d5b7ba0af2b47446e7c8c39464d5a8600fb6e5710d80aa5850869 Jun 03 23:02:37.246416 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.246377 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:37.355894 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.355852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:37.356073 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.356020 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:37.356125 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.356098 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:02:38.356077523 +0000 UTC m=+2.994170269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:37.456598 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.456559 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:37.456781 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.456613 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:37.456840 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.456822 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:37.456904 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.456841 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:37.456904 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.456853 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:37.457010 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.456916 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:38.456894482 +0000 UTC m=+3.094987213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:37.457084 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.457062 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:37.457333 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:37.457137 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:38.457119904 +0000 UTC m=+3.095212644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:37.791471 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.791354 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:57:36 +0000 UTC" deadline="2027-12-18 06:30:01.131453908 +0000 UTC" Jun 03 23:02:37.791471 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.791423 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13495h27m23.34003462s" Jun 03 23:02:37.828032 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.827987 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:37.838042 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.838006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rccsq" event={"ID":"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3","Type":"ContainerStarted","Data":"1073969d10f97ecc8105339a9c984e3452c9e9f588ed2d4f8c4dbfc272bbcfb6"} Jun 03 23:02:37.852805 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.852765 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7r47" event={"ID":"11117f0e-3040-496c-99d7-8b958ff3ae22","Type":"ContainerStarted","Data":"6e6f97b8a75e3386e389c9b8c594598a81f76804b5cad7174fef55b4982f6c7d"} Jun 03 23:02:37.860721 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.860689 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"69a1212200d90657ad73b324d13000ec44c38ef3a851aff8fe878b2773021e9d"} Jun 03 23:02:37.866308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.866215 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v255j" event={"ID":"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f","Type":"ContainerStarted","Data":"beed20283ae39b8ad744dacc3afccc8bb7f27d91c2115097f7163a885d713f3f"} Jun 03 23:02:37.879794 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.879715 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fw9vj" event={"ID":"4947f5bc-89b0-4d81-be6d-981aaef111fc","Type":"ContainerStarted","Data":"95c318180e61a8ab47e7d77121d88def86801bc37047b3ffb67c81b7ac9964db"} Jun 03 23:02:37.896073 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.896037 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z47gz" event={"ID":"16d90566-5c58-4f68-9f2a-03b15a95a75e","Type":"ContainerStarted","Data":"bf884bcc604d5b7ba0af2b47446e7c8c39464d5a8600fb6e5710d80aa5850869"} Jun 03 23:02:37.900468 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.900435 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerStarted","Data":"d421898ef97736e4f52d0d66ceb719fa9b3459f6574e1801840834f20f830776"} Jun 03 23:02:37.907888 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.907852 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" event={"ID":"160907c7-062b-4de8-8e44-830da2bfc0ed","Type":"ContainerStarted","Data":"bb575e9437f55835ed4cc7177afe783549a0bd3b05f8ac06954b478ea545cf04"} Jun 03 23:02:37.916094 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:37.916060 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" event={"ID":"2309d492-8f1a-491e-a53d-171b78b62edc","Type":"ContainerStarted","Data":"b6679d313be372194b363bbc282fa1dbf2eff2146f832b1522d454f7a0e0ba93"} Jun 03 23:02:38.364963 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.364892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:38.365213 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.365068 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:38.365213 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.365131 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:02:40.365113419 +0000 UTC m=+5.003206159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:38.465604 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.465567 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:38.465813 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.465619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:38.465875 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.465814 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:38.465875 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.465838 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:38.465875 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.465851 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:38.466025 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.465909 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:40.465890774 +0000 UTC m=+5.103983506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:38.466513 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.466322 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:38.466513 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.466375 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:40.466360524 +0000 UTC m=+5.104453253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:38.792448 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.792321 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:57:36 +0000 UTC" deadline="2028-01-27 11:15:47.99774911 +0000 UTC" Jun 03 23:02:38.792448 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.792362 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14460h13m9.205391833s" Jun 03 23:02:38.814703 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.814193 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:38.814703 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.814318 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:38.814703 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.814426 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:38.814703 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.814551 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:38.814703 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:38.814622 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:38.815107 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:38.814713 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:40.381032 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:40.380989 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:40.381511 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.381140 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:40.381511 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.381209 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:02:44.381189341 +0000 UTC m=+9.019282094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:40.481389 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:40.481346 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:40.481581 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:40.481402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:40.481581 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.481574 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:40.481730 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.481592 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:40.481730 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.481606 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:40.481730 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.481683 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:44.481665899 +0000 UTC m=+9.119758640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:40.482099 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.482076 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:40.482184 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.482134 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:44.482119561 +0000 UTC m=+9.120212303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:40.813751 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:40.813673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:40.813907 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.813806 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:40.813979 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:40.813958 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:40.814025 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:40.813971 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:40.814119 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.814095 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:40.814259 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:40.814234 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:42.813669 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:42.813551 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:42.813669 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:42.813593 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:42.814169 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:42.813697 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:42.814169 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:42.813567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:42.814169 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:42.814149 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:42.814322 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:42.814241 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:44.416063 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:44.416026 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:44.416515 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.416163 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:44.416515 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.416226 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:02:52.416208901 +0000 UTC m=+17.054301629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:44.516773 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:44.516665 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:44.516773 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:44.516736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:44.517036 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.516793 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:44.517036 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.516871 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:52.516850065 +0000 UTC m=+17.154942803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:44.517036 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.516935 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:44.517036 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.516951 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:44.517036 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.516963 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:44.517036 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.517014 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:52.5169979 +0000 UTC m=+17.155090643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:44.814382 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:44.814129 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:44.814382 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:44.814173 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:44.814382 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:44.814174 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:44.814382 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.814263 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:44.814718 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.814393 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:44.814718 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:44.814500 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:46.814357 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:46.814315 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:46.814357 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:46.814354 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:46.814936 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:46.814361 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:46.814936 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:46.814455 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:46.814936 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:46.814564 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:46.814936 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:46.814679 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:48.813528 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:48.813448 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:48.813926 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:48.813452 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:48.813926 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:48.813579 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:48.813926 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:48.813685 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:48.813926 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:48.813452 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:48.813926 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:48.813802 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:50.814275 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:50.814235 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:50.814275 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:50.814266 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:50.814820 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:50.814239 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:50.814820 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:50.814361 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:50.814820 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:50.814418 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:50.814820 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:50.814490 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:52.473925 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:52.473885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:52.474421 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.474067 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:52.474421 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.474150 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:03:08.474128646 +0000 UTC m=+33.112221373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:52.574834 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:52.574794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:52.575014 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:52.574842 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:52.575014 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.574969 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:52.575014 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.574992 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:52.575014 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.575006 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:52.575188 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.574969 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:52.575188 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.575070 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:08.575048914 +0000 UTC m=+33.213141662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:52.575188 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.575110 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:08.575092377 +0000 UTC m=+33.213185123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:52.814025 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:52.813939 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:52.814186 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:52.813939 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:52.814186 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.814072 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:52.814186 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:52.813938 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:52.814186 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.814152 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:52.814347 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:52.814244 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:54.813468 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:54.813253 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:54.813922 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:54.813317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:54.813922 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:54.813558 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:54.813922 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:54.813317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:54.813922 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:54.813620 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:54.813922 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:54.813835 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:56.813968 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.813870 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:56.813968 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.813871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:56.813968 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.813871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:56.814453 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:56.814035 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:56.814453 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:56.814089 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:56.814453 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:56.814127 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:56.965216 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.965140 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" event={"ID":"9af29b3c0ed1e2d0969b0e864a816d25","Type":"ContainerStarted","Data":"582cbb372192d5c7d0808af4f4adfab3cf9ef4397abdae1e272fdda476273ade"} Jun 03 23:02:56.966858 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.966829 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z47gz" event={"ID":"16d90566-5c58-4f68-9f2a-03b15a95a75e","Type":"ContainerStarted","Data":"c3226d19e3733b538f2ac1c2fe14f6401cb87d2e265f7302105c07a908618d1c"} Jun 03 23:02:56.968417 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.968389 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" event={"ID":"2309d492-8f1a-491e-a53d-171b78b62edc","Type":"ContainerStarted","Data":"f87e7ec66246688a0e998fe8d3ddf550edcb83291bb5003f313452a202edaf24"} Jun 03 23:02:56.986832 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:56.986768 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-203.ec2.internal" podStartSLOduration=20.986748605 podStartE2EDuration="20.986748605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:56.986192479 +0000 UTC m=+21.624285228" watchObservedRunningTime="2026-06-03 23:02:56.986748605 +0000 UTC m=+21.624841354" Jun 03 23:02:57.004931 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.004868 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cqq5c" podStartSLOduration=1.627844784 podStartE2EDuration="21.004837203s" totalImagesPullingTime="19.376992419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:57.003897763 +0000 UTC m=+21.641990514" watchObservedRunningTime="2026-06-03 23:02:57.004837203 +0000 UTC m=+21.642929952" Jun 03 23:02:57.024624 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.024565 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z47gz" podStartSLOduration=1.681605257 podStartE2EDuration="21.024539935s" totalImagesPullingTime="19.342934678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:57.023642363 +0000 UTC m=+21.661735110" watchObservedRunningTime="2026-06-03 23:02:57.024539935 +0000 UTC m=+21.662632688" Jun 03 23:02:57.972235 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.972007 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rccsq" event={"ID":"d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3","Type":"ContainerStarted","Data":"7a92c6974ce78d4a3482175e46e4c3c9805b8d30e65b5da57722a810ef056a24"} Jun 03 23:02:57.973562 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.973534 2552 generic.go:356] "Generic (PLEG): container finished" podID="8a52e9921bc0b2ecdffb8b18fe74b17e" containerID="5abd5ed292bdd84720feb491d3e878247af82f7c24438afbd4038a900703cb68" exitCode=0 Jun 03 23:02:57.973677 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.973603 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" event={"ID":"8a52e9921bc0b2ecdffb8b18fe74b17e","Type":"ContainerDied","Data":"5abd5ed292bdd84720feb491d3e878247af82f7c24438afbd4038a900703cb68"} Jun 03 23:02:57.975001 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.974982 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7r47" event={"ID":"11117f0e-3040-496c-99d7-8b958ff3ae22","Type":"ContainerStarted","Data":"3824c8e7ab4e8b280298820901211e9ba054f3e6c8fa1dc373b96fc8214871ab"} Jun 03 23:02:57.977823 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.977804 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"5fb3acb1248154fe8046b37b99de54eae50d58d43aeca44e49b14efae3e2fe88"} Jun 03 23:02:57.977916 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.977863 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"3d97db6994072d242f1a34508296655e0bb9dbd34155da1c2b8270480e09c58c"} Jun 03 23:02:57.977916 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.977893 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"3b9f3d8524cf7f2f642f0d2c95c177981c9c5bfeb217bd02d8755532556f3b54"} Jun 03 23:02:57.978020 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.977929 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"57c9711576973cfd68bf754a755ad4c3ecdd494644d3ab90a45a9eb7acd0c332"} Jun 03 23:02:57.978020 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.977958 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"4bf0ba81a1e6bcbc1bbeba8af87e5495b5f7d7ce4e7794577b4c120121cd0ec9"} Jun 03 23:02:57.978020 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.977994 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"b9f2d6e888e10f45fb1e6bf08f88817d87bffe723b19efd1d41154bce0b1ec50"} Jun 03 23:02:57.979091 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.979068 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fw9vj" event={"ID":"4947f5bc-89b0-4d81-be6d-981aaef111fc","Type":"ContainerStarted","Data":"61ca83b7a035845f28f89d52a9ba96837061d2294167c5fd9d55a79daaaa0c0d"} Jun 03 23:02:57.980336 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.980315 2552 generic.go:356] "Generic (PLEG): container finished" podID="55099152-e89d-4922-85b8-42c1469d3c30" containerID="bd0e81eca0284113dc9ddbc2949e08c02107b78d19170628d17523237640389a" exitCode=0 Jun 03 23:02:57.980411 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.980394 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerDied","Data":"bd0e81eca0284113dc9ddbc2949e08c02107b78d19170628d17523237640389a"} Jun 03 23:02:57.981846 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.981810 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" event={"ID":"160907c7-062b-4de8-8e44-830da2bfc0ed","Type":"ContainerStarted","Data":"65b31b525eca30f31f12f360485805f50024988fb1d548bf096575eac13a0543"} Jun 03 23:02:57.987576 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:57.987525 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rccsq" podStartSLOduration=3.614455504 podStartE2EDuration="22.987507454s" totalImagesPullingTime="19.37305195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:57.986322656 +0000 UTC m=+22.624415406" watchObservedRunningTime="2026-06-03 23:02:57.987507454 +0000 UTC m=+22.625600203" Jun 03 23:02:58.025417 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.025352 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fw9vj" podStartSLOduration=2.680519463 podStartE2EDuration="22.025331001s" totalImagesPullingTime="19.344811538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:58.02451148 +0000 UTC m=+22.662604228" watchObservedRunningTime="2026-06-03 23:02:58.025331001 +0000 UTC m=+22.663423751" Jun 03 23:02:58.041858 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.041804 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p7r47" podStartSLOduration=2.685756615 podStartE2EDuration="22.041783785s" totalImagesPullingTime="19.35602717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:58.041599825 +0000 UTC m=+22.679692573" watchObservedRunningTime="2026-06-03 23:02:58.041783785 +0000 UTC m=+22.679876533" Jun 03 23:02:58.814365 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.814329 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:02:58.814602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.814380 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:02:58.814602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.814329 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:02:58.814602 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:58.814475 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:02:58.814795 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:58.814597 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:02:58.814795 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:02:58.814713 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:02:58.909794 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.909760 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 23:02:58.986621 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.986580 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v255j" event={"ID":"37a1b2ab-303f-4dc9-8e92-c2d4d0a6458f","Type":"ContainerStarted","Data":"1cb28a5b01ef2011bd23fcd9d65e7ea9343e7c58f57d379e1ae17dae49738a6c"} Jun 03 23:02:58.988628 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:58.988588 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" event={"ID":"160907c7-062b-4de8-8e44-830da2bfc0ed","Type":"ContainerStarted","Data":"399856e2db48670bd92ef3b2fb5b2e9fe60b0425f60e34f8e1f39368b7797097"} Jun 03 23:02:59.004331 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:59.004268 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v255j" podStartSLOduration=3.640165133 podStartE2EDuration="23.00424804s" totalImagesPullingTime="19.364082907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:59.003841147 +0000 UTC m=+23.641933906" watchObservedRunningTime="2026-06-03 23:02:59.00424804 +0000 UTC m=+23.642340791" Jun 03 23:02:59.816221 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:59.816112 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T23:02:58.909777325Z","UUID":"eb695207-87fc-49e2-a87b-103d189510b4","Handler":null,"Name":"","Endpoint":""} Jun 03 23:02:59.817915 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:59.817892 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 23:02:59.818049 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:59.817938 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 23:02:59.995412 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:59.995325 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"4c4360855be32ac53f119dc8abc4078f7ed6107ad9a689c192acf862d0717b46"} Jun 03 23:02:59.997440 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:02:59.997379 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" event={"ID":"8a52e9921bc0b2ecdffb8b18fe74b17e","Type":"ContainerStarted","Data":"bf42298e4a1da98feddbc42efdf32023b7d66d1287bb756ef09bbf8eaf88d8c6"} Jun 03 23:03:00.021150 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:00.021089 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-203.ec2.internal" podStartSLOduration=24.021068146 podStartE2EDuration="24.021068146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:00.020397856 +0000 UTC m=+24.658490605" watchObservedRunningTime="2026-06-03 23:03:00.021068146 +0000 UTC m=+24.659160894" Jun 03 23:03:00.814064 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:00.814031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:00.814238 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:00.814150 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:00.814238 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:00.814158 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:03:00.814238 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:00.814187 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:00.814411 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:00.814289 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:03:00.814411 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:00.814379 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:03:01.001728 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:01.001686 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" event={"ID":"160907c7-062b-4de8-8e44-830da2bfc0ed","Type":"ContainerStarted","Data":"daacf28806160be14b8dc0087794effbe6544cf5774ad1bda92dc4732bb9d111"} Jun 03 23:03:01.023922 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:01.023857 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgrlt" podStartSLOduration=3.444691418 podStartE2EDuration="25.023837805s" totalImagesPullingTime="21.579146387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:01.023321493 +0000 UTC m=+25.661414240" watchObservedRunningTime="2026-06-03 23:03:01.023837805 +0000 UTC m=+25.661930554" Jun 03 23:03:01.836367 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:01.836331 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:03:02.610721 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:02.610525 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:03:02.611382 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:02.611247 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:03:02.814066 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:02.813974 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:02.814207 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:02.813974 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:02.814207 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:02.814094 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:03:02.814207 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:02.813974 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:02.814207 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:02.814158 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:03:02.814357 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:02.814248 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:03:03.007173 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:03.007135 2552 generic.go:356] "Generic (PLEG): container finished" podID="55099152-e89d-4922-85b8-42c1469d3c30" containerID="7b671a395497abad5f235a3c45216fbbfbf5d1da0754ebf405dad1ed6ed2dde7" exitCode=0 Jun 03 23:03:03.007348 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:03.007224 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerDied","Data":"7b671a395497abad5f235a3c45216fbbfbf5d1da0754ebf405dad1ed6ed2dde7"} Jun 03 23:03:03.010975 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:03.010949 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" event={"ID":"a9e42b86-17da-4a57-a0c8-26fd865f1ded","Type":"ContainerStarted","Data":"0725a799ea46f4e871210a83613edc4a61be177dfe1c83f23d399843ffe70628"} Jun 03 23:03:03.011880 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:03.011858 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p7r47" Jun 03 23:03:03.076086 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:03.076036 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" podStartSLOduration=7.227966158 podStartE2EDuration="27.076016136s" totalImagesPullingTime="19.848049978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:03.07529457 +0000 UTC m=+27.713387318" watchObservedRunningTime="2026-06-03 23:03:03.076016136 +0000 UTC m=+27.714108883" Jun 03 23:03:04.014258 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.014016 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:03:04.014749 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.014315 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:03:04.014749 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.014365 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:03:04.029557 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.029531 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:03:04.029818 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.029782 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:03:04.332216 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.332178 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4ld4"] Jun 03 23:03:04.332369 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.332349 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:04.332484 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:04.332455 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:03:04.335629 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.335597 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6l7xg"] Jun 03 23:03:04.335885 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.335836 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:04.335994 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.335900 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rgfjc"] Jun 03 23:03:04.336159 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:04.336128 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:03:04.336835 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:04.336214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:04.336835 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:04.336296 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:03:05.017848 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:05.017814 2552 generic.go:356] "Generic (PLEG): container finished" podID="55099152-e89d-4922-85b8-42c1469d3c30" containerID="7cb29e9fc617bab27971b61b15d439deba88b20b9afb0512b1dc3a65b59f43cd" exitCode=0 Jun 03 23:03:05.018330 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:05.017900 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerDied","Data":"7cb29e9fc617bab27971b61b15d439deba88b20b9afb0512b1dc3a65b59f43cd"} Jun 03 23:03:05.814054 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:05.814023 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:05.814215 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:05.814121 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:03:05.814215 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:05.814160 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:05.814279 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:05.814216 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:03:06.813638 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:06.813548 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:06.814054 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:06.813731 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:03:07.024802 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:07.024762 2552 generic.go:356] "Generic (PLEG): container finished" podID="55099152-e89d-4922-85b8-42c1469d3c30" containerID="2990383c74a17316f5d6d3efdd720963a3695c3d4d970d411666557f75a7b708" exitCode=0 Jun 03 23:03:07.024969 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:07.024835 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerDied","Data":"2990383c74a17316f5d6d3efdd720963a3695c3d4d970d411666557f75a7b708"} Jun 03 23:03:07.813999 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:07.813930 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:07.814514 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:07.814128 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:07.814514 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:07.814236 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6l7xg" podUID="ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d" Jun 03 23:03:07.814514 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:07.814059 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgfjc" podUID="c968e010-6e95-4a9f-9301-d257c47c5b48" Jun 03 23:03:08.488838 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:08.488804 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:08.489024 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.488982 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:03:08.489102 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.489062 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs podName:ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d nodeName:}" failed. No retries permitted until 2026-06-03 23:03:40.489038648 +0000 UTC m=+65.127131388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs") pod "network-metrics-daemon-6l7xg" (UID: "ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:03:08.589466 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:08.589425 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:08.589641 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:08.589479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:08.589641 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.589545 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:03:08.589641 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.589615 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret podName:d71ee51b-4b7e-43db-b863-8fef4edf3c04 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:40.589596259 +0000 UTC m=+65.227688986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret") pod "global-pull-secret-syncer-z4ld4" (UID: "d71ee51b-4b7e-43db-b863-8fef4edf3c04") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:03:08.589641 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.589636 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:03:08.589834 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.589670 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:03:08.589834 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.589684 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4jnjt for pod openshift-network-diagnostics/network-check-target-rgfjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:03:08.589834 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.589739 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt podName:c968e010-6e95-4a9f-9301-d257c47c5b48 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:40.58972365 +0000 UTC m=+65.227816381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jnjt" (UniqueName: "kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt") pod "network-check-target-rgfjc" (UID: "c968e010-6e95-4a9f-9301-d257c47c5b48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:03:08.813742 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:08.813709 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:08.813932 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:08.813852 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4ld4" podUID="d71ee51b-4b7e-43db-b863-8fef4edf3c04" Jun 03 23:03:09.701427 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.701397 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-203.ec2.internal" event="NodeReady" Jun 03 23:03:09.701870 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.701543 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 23:03:09.745117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.745085 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx"] Jun 03 23:03:09.777145 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.777104 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8"] Jun 03 23:03:09.777333 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.777308 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:09.781604 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.781575 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 23:03:09.782336 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.782301 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.782593 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.782571 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7j6tg\"" Jun 03 23:03:09.782694 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.782582 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.783050 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.783015 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 23:03:09.793236 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.793169 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64"] Jun 03 23:03:09.793601 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.793580 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:09.799827 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.796171 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 23:03:09.799827 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.796381 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.799827 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.798723 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w8j7v\"" Jun 03 23:03:09.799827 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.799010 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.799827 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.800496 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 23:03:09.831303 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.831264 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-649b76b4c9-xp2p4"] Jun 03 23:03:09.831831 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.831795 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:09.834010 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.833984 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 23:03:09.834372 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.834338 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.834473 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.834424 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-thnx6\"" Jun 03 23:03:09.834519 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.834486 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.850936 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.850906 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-5bb94"] Jun 03 23:03:09.851111 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.851096 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.851756 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.851225 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:09.851960 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.851905 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:09.855404 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.855382 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 23:03:09.856437 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.856416 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:03:09.857191 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.857168 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 23:03:09.857286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.857266 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-256x8\"" Jun 03 23:03:09.857543 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.857522 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 23:03:09.857688 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.857633 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.858388 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.858368 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.858640 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.858615 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gw87n\"" Jun 03 23:03:09.859138 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.859075 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skdgk\"" Jun 03 23:03:09.865181 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.865159 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 23:03:09.875201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.875171 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:09.879102 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.879081 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-nkf2l"] Jun 03 23:03:09.879514 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.879494 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.882846 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.882825 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 23:03:09.882930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.882850 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 23:03:09.882930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.882864 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.883069 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.883023 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dc96z\"" Jun 03 23:03:09.887606 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.887586 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 23:03:09.900828 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900799 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhsg\" (UniqueName: \"kubernetes.io/projected/527a2086-5893-4b12-a688-62ae8637aca6-kube-api-access-6dhsg\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:09.900964 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900835 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/890cc999-5596-41e2-b811-6866c04be7f9-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:09.900964 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900882 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.900964 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900912 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36ce1586-40d8-4e0d-9d3b-95153d5d5048-ca-trust-extracted\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.900964 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900934 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-installation-pull-secrets\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.900964 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900953 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-image-registry-private-configuration\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.900971 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/890cc999-5596-41e2-b811-6866c04be7f9-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901002 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-certificates\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7dec70f7-b883-4149-82ea-c48d0b02ad1a-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-bound-sa-token\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cztt\" (UniqueName: \"kubernetes.io/projected/890cc999-5596-41e2-b811-6866c04be7f9-kube-api-access-7cztt\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:09.901171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901137 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:09.901475 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xld82\" (UniqueName: \"kubernetes.io/projected/7dec70f7-b883-4149-82ea-c48d0b02ad1a-kube-api-access-xld82\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:09.901475 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901321 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-trusted-ca\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.901475 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.901358 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5px7b\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-kube-api-access-5px7b\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:09.905491 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.905471 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq"] Jun 03 23:03:09.905626 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.905612 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:09.907808 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.907789 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 23:03:09.908235 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.908211 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 23:03:09.908333 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.908261 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-txjm4\"" Jun 03 23:03:09.921365 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921345 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx"] Jun 03 23:03:09.921462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921373 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-nkf2l"] Jun 03 23:03:09.921462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921387 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8"] Jun 03 23:03:09.921462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921407 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64"] Jun 03 23:03:09.921462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921427 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649b76b4c9-xp2p4"] Jun 03 23:03:09.921462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921443 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-pzc9r"] Jun 03 23:03:09.921703 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.921559 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" Jun 03 23:03:09.924350 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.924331 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mn8km\"" Jun 03 23:03:09.924472 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.924334 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.924472 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.924335 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.943398 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.943368 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pz9vg"] Jun 03 23:03:09.943564 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.943494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:09.947601 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.947576 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 23:03:09.948134 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.948107 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.948280 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.948191 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 23:03:09.948280 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.948246 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.948441 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.948249 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s72pg\"" Jun 03 23:03:09.958276 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.958208 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 23:03:09.963315 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.963293 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls"] Jun 03 23:03:09.963445 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.963415 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:09.970561 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.970536 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 23:03:09.970826 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.970808 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2gws\"" Jun 03 23:03:09.971215 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.971106 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 23:03:09.983555 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.983526 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c989f8d7c-7z85d"] Jun 03 23:03:09.983695 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.983670 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:09.989700 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.989679 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 23:03:09.989835 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.989718 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.989901 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.989856 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 23:03:09.989951 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.989856 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-scgrt\"" Jun 03 23:03:09.990040 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.990022 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:03:09.995627 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.995607 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fkq6s"] Jun 03 23:03:09.995764 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.995747 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:09.999269 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.999251 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 23:03:09.999466 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.999444 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 23:03:09.999572 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.999448 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 23:03:09.999697 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.999675 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 23:03:09.999795 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:09.999678 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 23:03:10.000070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.000048 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8bx9k\"" Jun 03 23:03:10.000165 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.000076 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 23:03:10.001848 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.001825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.001935 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.001865 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-installation-pull-secrets\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.001935 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.001893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/49f30332-91b0-41a7-b40a-4b54c668c69b-nginx-conf\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:10.001935 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.001922 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-image-registry-private-configuration\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.001945 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6p62\" (UniqueName: \"kubernetes.io/projected/1c62a181-9541-49a9-968a-0a3fe29ef5fb-kube-api-access-c6p62\") pod \"volume-data-source-validator-78dd696465-c6lnq\" (UID: \"1c62a181-9541-49a9-968a-0a3fe29ef5fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.001967 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7dec70f7-b883-4149-82ea-c48d0b02ad1a-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.001968 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.001992 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-649b76b4c9-xp2p4: secret "image-registry-tls" not found Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002009 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg899\" (UniqueName: \"kubernetes.io/projected/0d79e31f-a188-4619-96e6-8c24e88d8956-kube-api-access-wg899\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld82\" (UniqueName: \"kubernetes.io/projected/7dec70f7-b883-4149-82ea-c48d0b02ad1a-kube-api-access-xld82\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-trusted-ca\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.002139 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.002120 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls podName:36ce1586-40d8-4e0d-9d3b-95153d5d5048 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.502098578 +0000 UTC m=+35.140191304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls") pod "image-registry-649b76b4c9-xp2p4" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048") : secret "image-registry-tls" not found Jun 03 23:03:10.002588 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002252 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-config\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.002588 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002285 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5px7b\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-kube-api-access-5px7b\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.002588 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002326 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhsg\" (UniqueName: \"kubernetes.io/projected/527a2086-5893-4b12-a688-62ae8637aca6-kube-api-access-6dhsg\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:10.002588 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002354 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/890cc999-5596-41e2-b811-6866c04be7f9-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.002588 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-serving-cert\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.002588 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002484 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36ce1586-40d8-4e0d-9d3b-95153d5d5048-ca-trust-extracted\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002839 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/890cc999-5596-41e2-b811-6866c04be7f9-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002892 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-trusted-ca\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002957 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-certificates\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.002985 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d79e31f-a188-4619-96e6-8c24e88d8956-snapshots\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003016 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d79e31f-a188-4619-96e6-8c24e88d8956-tmp\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.003070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003047 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-bound-sa-token\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003072 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cztt\" (UniqueName: \"kubernetes.io/projected/890cc999-5596-41e2-b811-6866c04be7f9-kube-api-access-7cztt\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003103 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d79e31f-a188-4619-96e6-8c24e88d8956-trusted-ca-bundle\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003182 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d79e31f-a188-4619-96e6-8c24e88d8956-serving-cert\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d79e31f-a188-4619-96e6-8c24e88d8956-service-ca-bundle\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003276 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4n6k\" (UniqueName: \"kubernetes.io/projected/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-kube-api-access-d4n6k\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.003344 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.003279 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:10.003678 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.003384 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls podName:7dec70f7-b883-4149-82ea-c48d0b02ad1a nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.503366951 +0000 UTC m=+35.141459693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhfnx" (UID: "7dec70f7-b883-4149-82ea-c48d0b02ad1a") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:10.003678 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.003414 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:03:10.003678 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003455 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7dec70f7-b883-4149-82ea-c48d0b02ad1a-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:10.003678 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.003463 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls podName:527a2086-5893-4b12-a688-62ae8637aca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.503447618 +0000 UTC m=+35.141540361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-4lt64" (UID: "527a2086-5893-4b12-a688-62ae8637aca6") : secret "samples-operator-tls" not found Jun 03 23:03:10.003678 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.003104 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-trusted-ca\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.004155 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.004130 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36ce1586-40d8-4e0d-9d3b-95153d5d5048-ca-trust-extracted\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.004736 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.004298 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/890cc999-5596-41e2-b811-6866c04be7f9-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.004736 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.004332 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-certificates\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.007076 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.006909 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/890cc999-5596-41e2-b811-6866c04be7f9-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.007190 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.007038 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-installation-pull-secrets\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.007422 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.007400 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-image-registry-private-configuration\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.012199 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.012174 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r"] Jun 03 23:03:10.012354 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.012334 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.015943 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.015903 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 23:03:10.016083 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.016034 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zn6wk\"" Jun 03 23:03:10.016397 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.016376 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 23:03:10.018592 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.018571 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 23:03:10.021688 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.021665 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cztt\" (UniqueName: \"kubernetes.io/projected/890cc999-5596-41e2-b811-6866c04be7f9-kube-api-access-7cztt\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8\" (UID: \"890cc999-5596-41e2-b811-6866c04be7f9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.021839 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.021809 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-bound-sa-token\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.021942 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.021870 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xld82\" (UniqueName: \"kubernetes.io/projected/7dec70f7-b883-4149-82ea-c48d0b02ad1a-kube-api-access-xld82\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:10.022597 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.022543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5px7b\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-kube-api-access-5px7b\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.023853 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.023816 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhsg\" (UniqueName: \"kubernetes.io/projected/527a2086-5893-4b12-a688-62ae8637aca6-kube-api-access-6dhsg\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:10.028363 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028330 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-pzc9r"] Jun 03 23:03:10.028363 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028371 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-5bb94"] Jun 03 23:03:10.028552 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028395 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq"] Jun 03 23:03:10.028552 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028419 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r"] Jun 03 23:03:10.028552 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028440 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls"] Jun 03 23:03:10.028552 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028460 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fkq6s"] Jun 03 23:03:10.028552 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028480 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pz9vg"] Jun 03 23:03:10.028832 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028619 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c989f8d7c-7z85d"] Jun 03 23:03:10.028993 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.028919 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" Jun 03 23:03:10.031746 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.031584 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mmbm9\"" Jun 03 23:03:10.105179 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32101c5-6407-4b0b-8795-f985fd873544-cert\") pod \"ingress-canary-fkq6s\" (UID: \"b32101c5-6407-4b0b-8795-f985fd873544\") " pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.105179 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105185 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxg2k\" (UniqueName: \"kubernetes.io/projected/9c575b89-b1a3-4565-a3b3-e99847a93e57-kube-api-access-pxg2k\") pod \"network-check-source-dbd9cf844-7r55r\" (UID: \"9c575b89-b1a3-4565-a3b3-e99847a93e57\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" Jun 03 23:03:10.105393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-stats-auth\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.105393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105265 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/49f30332-91b0-41a7-b40a-4b54c668c69b-nginx-conf\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:10.105393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105290 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrdbn\" (UniqueName: \"kubernetes.io/projected/b32101c5-6407-4b0b-8795-f985fd873544-kube-api-access-mrdbn\") pod \"ingress-canary-fkq6s\" (UID: \"b32101c5-6407-4b0b-8795-f985fd873544\") " pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.105393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105316 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6p62\" (UniqueName: \"kubernetes.io/projected/1c62a181-9541-49a9-968a-0a3fe29ef5fb-kube-api-access-c6p62\") pod \"volume-data-source-validator-78dd696465-c6lnq\" (UID: \"1c62a181-9541-49a9-968a-0a3fe29ef5fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" Jun 03 23:03:10.105602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105351 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snz8j\" (UniqueName: \"kubernetes.io/projected/798d3498-5713-473b-a7b8-ad5e9fe6f658-kube-api-access-snz8j\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.105602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-default-certificate\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.105602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105459 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-tmp-dir\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.105602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-config\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.105819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105604 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg899\" (UniqueName: \"kubernetes.io/projected/0d79e31f-a188-4619-96e6-8c24e88d8956-kube-api-access-wg899\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.105819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105664 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-config-volume\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.105819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105699 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2kr\" (UniqueName: \"kubernetes.io/projected/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-kube-api-access-wp2kr\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.105819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105732 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-config\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.105819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105768 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-serving-cert\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.105819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105793 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.106053 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105826 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gn2\" (UniqueName: \"kubernetes.io/projected/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-kube-api-access-k4gn2\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.106053 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105871 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-trusted-ca\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.106053 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105924 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d79e31f-a188-4619-96e6-8c24e88d8956-snapshots\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106053 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.105972 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d79e31f-a188-4619-96e6-8c24e88d8956-tmp\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106053 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106126 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d79e31f-a188-4619-96e6-8c24e88d8956-trusted-ca-bundle\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106154 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d79e31f-a188-4619-96e6-8c24e88d8956-serving-cert\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106180 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/49f30332-91b0-41a7-b40a-4b54c668c69b-nginx-conf\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106192 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d79e31f-a188-4619-96e6-8c24e88d8956-service-ca-bundle\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106232 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:10.106266 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106262 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4n6k\" (UniqueName: \"kubernetes.io/projected/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-kube-api-access-d4n6k\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.106549 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106312 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-serving-cert\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.106549 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.106365 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:03:10.106549 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.106434 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert podName:49f30332-91b0-41a7-b40a-4b54c668c69b nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.606415713 +0000 UTC m=+35.244508453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-nkf2l" (UID: "49f30332-91b0-41a7-b40a-4b54c668c69b") : secret "networking-console-plugin-cert" not found Jun 03 23:03:10.106682 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106631 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d79e31f-a188-4619-96e6-8c24e88d8956-snapshots\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106718 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106676 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-config\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.106718 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d79e31f-a188-4619-96e6-8c24e88d8956-tmp\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.106806 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106754 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-trusted-ca\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.106806 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.106791 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d79e31f-a188-4619-96e6-8c24e88d8956-service-ca-bundle\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.107417 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.107395 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d79e31f-a188-4619-96e6-8c24e88d8956-trusted-ca-bundle\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.109178 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.109155 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d79e31f-a188-4619-96e6-8c24e88d8956-serving-cert\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.109293 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.109157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-serving-cert\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.121071 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.121041 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" Jun 03 23:03:10.122494 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.122465 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg899\" (UniqueName: \"kubernetes.io/projected/0d79e31f-a188-4619-96e6-8c24e88d8956-kube-api-access-wg899\") pod \"insights-operator-69684796bc-5bb94\" (UID: \"0d79e31f-a188-4619-96e6-8c24e88d8956\") " pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.123935 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.123914 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6p62\" (UniqueName: \"kubernetes.io/projected/1c62a181-9541-49a9-968a-0a3fe29ef5fb-kube-api-access-c6p62\") pod \"volume-data-source-validator-78dd696465-c6lnq\" (UID: \"1c62a181-9541-49a9-968a-0a3fe29ef5fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" Jun 03 23:03:10.124026 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.123955 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4n6k\" (UniqueName: \"kubernetes.io/projected/8dbc20d5-2bcf-47b3-86d0-9cd73832f899-kube-api-access-d4n6k\") pod \"console-operator-85bd8fd97d-pzc9r\" (UID: \"8dbc20d5-2bcf-47b3-86d0-9cd73832f899\") " pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.186326 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.186261 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-5bb94" Jun 03 23:03:10.207536 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207502 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snz8j\" (UniqueName: \"kubernetes.io/projected/798d3498-5713-473b-a7b8-ad5e9fe6f658-kube-api-access-snz8j\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.207536 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207542 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-default-certificate\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.207799 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-tmp-dir\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.207799 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207612 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-config\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.207799 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-config-volume\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.207799 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207689 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2kr\" (UniqueName: \"kubernetes.io/projected/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-kube-api-access-wp2kr\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.207799 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207726 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.207799 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207756 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gn2\" (UniqueName: \"kubernetes.io/projected/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-kube-api-access-k4gn2\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207848 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.207875 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-serving-cert\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.207945 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.707924329 +0000 UTC m=+35.346017058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : secret "router-metrics-certs-default" not found Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207985 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32101c5-6407-4b0b-8795-f985fd873544-cert\") pod \"ingress-canary-fkq6s\" (UID: \"b32101c5-6407-4b0b-8795-f985fd873544\") " pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.207996 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-tmp-dir\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.208018 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxg2k\" (UniqueName: \"kubernetes.io/projected/9c575b89-b1a3-4565-a3b3-e99847a93e57-kube-api-access-pxg2k\") pod \"network-check-source-dbd9cf844-7r55r\" (UID: \"9c575b89-b1a3-4565-a3b3-e99847a93e57\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.208035 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.708021134 +0000 UTC m=+35.346113894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : configmap references non-existent config key: service-ca.crt Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.208072 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-stats-auth\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.208101 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.208093 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:10.208677 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.208161 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls podName:d608acf6-e9d4-493d-82f8-bcc5ee9106f9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:10.708149782 +0000 UTC m=+35.346242515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls") pod "dns-default-pz9vg" (UID: "d608acf6-e9d4-493d-82f8-bcc5ee9106f9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:10.208677 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.208237 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-config\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.208677 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.208299 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrdbn\" (UniqueName: \"kubernetes.io/projected/b32101c5-6407-4b0b-8795-f985fd873544-kube-api-access-mrdbn\") pod \"ingress-canary-fkq6s\" (UID: \"b32101c5-6407-4b0b-8795-f985fd873544\") " pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.208830 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.208751 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-config-volume\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.210822 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.210799 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-serving-cert\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.210914 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.210851 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-default-certificate\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.210998 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.210980 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32101c5-6407-4b0b-8795-f985fd873544-cert\") pod \"ingress-canary-fkq6s\" (UID: \"b32101c5-6407-4b0b-8795-f985fd873544\") " pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.218382 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.218352 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-stats-auth\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.224301 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.224277 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snz8j\" (UniqueName: \"kubernetes.io/projected/798d3498-5713-473b-a7b8-ad5e9fe6f658-kube-api-access-snz8j\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.225774 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.225750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gn2\" (UniqueName: \"kubernetes.io/projected/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-kube-api-access-k4gn2\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.226263 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.226242 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2kr\" (UniqueName: \"kubernetes.io/projected/6564a1bc-b4a8-4a8b-9609-ab627589e7fc-kube-api-access-wp2kr\") pod \"service-ca-operator-5bc4cf794b-qbqls\" (UID: \"6564a1bc-b4a8-4a8b-9609-ab627589e7fc\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.226804 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.226788 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxg2k\" (UniqueName: \"kubernetes.io/projected/9c575b89-b1a3-4565-a3b3-e99847a93e57-kube-api-access-pxg2k\") pod \"network-check-source-dbd9cf844-7r55r\" (UID: \"9c575b89-b1a3-4565-a3b3-e99847a93e57\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" Jun 03 23:03:10.228291 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.228271 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrdbn\" (UniqueName: \"kubernetes.io/projected/b32101c5-6407-4b0b-8795-f985fd873544-kube-api-access-mrdbn\") pod \"ingress-canary-fkq6s\" (UID: \"b32101c5-6407-4b0b-8795-f985fd873544\") " pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.230969 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.230948 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" Jun 03 23:03:10.254151 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.254115 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:10.294364 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.294331 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" Jun 03 23:03:10.342398 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.342359 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkq6s" Jun 03 23:03:10.347533 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.347501 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" Jun 03 23:03:10.512511 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.512411 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:10.512511 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.512488 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.512588 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512621 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512683 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512717 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512725 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls podName:7dec70f7-b883-4149-82ea-c48d0b02ad1a nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.512703247 +0000 UTC m=+36.150795979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhfnx" (UID: "7dec70f7-b883-4149-82ea-c48d0b02ad1a") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512749 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls podName:527a2086-5893-4b12-a688-62ae8637aca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.512738282 +0000 UTC m=+36.150831009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-4lt64" (UID: "527a2086-5893-4b12-a688-62ae8637aca6") : secret "samples-operator-tls" not found Jun 03 23:03:10.512767 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512729 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-649b76b4c9-xp2p4: secret "image-registry-tls" not found Jun 03 23:03:10.513114 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.512837 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls podName:36ce1586-40d8-4e0d-9d3b-95153d5d5048 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.512822543 +0000 UTC m=+36.150915273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls") pod "image-registry-649b76b4c9-xp2p4" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048") : secret "image-registry-tls" not found Jun 03 23:03:10.613577 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.613532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:10.613805 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.613727 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:03:10.613805 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.613800 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert podName:49f30332-91b0-41a7-b40a-4b54c668c69b nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.613779336 +0000 UTC m=+36.251872062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-nkf2l" (UID: "49f30332-91b0-41a7-b40a-4b54c668c69b") : secret "networking-console-plugin-cert" not found Jun 03 23:03:10.714875 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.714837 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.714902 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.715020 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.715032 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.715015815 +0000 UTC m=+36.353108541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : configmap references non-existent config key: service-ca.crt Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.715069 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls podName:d608acf6-e9d4-493d-82f8-bcc5ee9106f9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.715055832 +0000 UTC m=+36.353148579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls") pod "dns-default-pz9vg" (UID: "d608acf6-e9d4-493d-82f8-bcc5ee9106f9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.715182 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.715273 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:03:10.715341 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:10.715311 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:11.715299176 +0000 UTC m=+36.353391905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : secret "router-metrics-certs-default" not found Jun 03 23:03:10.814001 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.813906 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:10.817225 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:10.817202 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:03:11.332676 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.332633 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fkq6s"] Jun 03 23:03:11.334987 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.334965 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-5bb94"] Jun 03 23:03:11.337818 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.337766 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-pzc9r"] Jun 03 23:03:11.341545 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.341524 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r"] Jun 03 23:03:11.345322 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.345298 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq"] Jun 03 23:03:11.348735 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.348643 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls"] Jun 03 23:03:11.349561 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.349540 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8"] Jun 03 23:03:11.357157 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.357133 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32101c5_6407_4b0b_8795_f985fd873544.slice/crio-b26ff927fb9373f99d93fe31d2d80f1cc47a0fad97d419cf2df33597dbd89e48 WatchSource:0}: Error finding container b26ff927fb9373f99d93fe31d2d80f1cc47a0fad97d419cf2df33597dbd89e48: Status 404 returned error can't find the container with id b26ff927fb9373f99d93fe31d2d80f1cc47a0fad97d419cf2df33597dbd89e48 Jun 03 23:03:11.357404 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.357379 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d79e31f_a188_4619_96e6_8c24e88d8956.slice/crio-dab24bca3e8cbfe6adc411c7506221e55e4d8f767e12a18ab76a1f4def3c2bdb WatchSource:0}: Error finding container dab24bca3e8cbfe6adc411c7506221e55e4d8f767e12a18ab76a1f4def3c2bdb: Status 404 returned error can't find the container with id dab24bca3e8cbfe6adc411c7506221e55e4d8f767e12a18ab76a1f4def3c2bdb Jun 03 23:03:11.358395 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.358366 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbc20d5_2bcf_47b3_86d0_9cd73832f899.slice/crio-0088f7ce72a0b8623a3422bc18946d675af6fc053ec0d3aa7dc9b7f703f06b3e WatchSource:0}: Error finding container 0088f7ce72a0b8623a3422bc18946d675af6fc053ec0d3aa7dc9b7f703f06b3e: Status 404 returned error can't find the container with id 0088f7ce72a0b8623a3422bc18946d675af6fc053ec0d3aa7dc9b7f703f06b3e Jun 03 23:03:11.359406 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.359377 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c575b89_b1a3_4565_a3b3_e99847a93e57.slice/crio-c34637eef25e1af1d8c8b14402939b529a7dc1eff83396635d64bc64f8864b57 WatchSource:0}: Error finding container c34637eef25e1af1d8c8b14402939b529a7dc1eff83396635d64bc64f8864b57: Status 404 returned error can't find the container with id c34637eef25e1af1d8c8b14402939b529a7dc1eff83396635d64bc64f8864b57 Jun 03 23:03:11.360037 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.359968 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c62a181_9541_49a9_968a_0a3fe29ef5fb.slice/crio-af4e514c5a2c6c0618ae376013d73ee9e3511e8f10e895fd048ccedabe5a676c WatchSource:0}: Error finding container af4e514c5a2c6c0618ae376013d73ee9e3511e8f10e895fd048ccedabe5a676c: Status 404 returned error can't find the container with id af4e514c5a2c6c0618ae376013d73ee9e3511e8f10e895fd048ccedabe5a676c Jun 03 23:03:11.362570 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.362548 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6564a1bc_b4a8_4a8b_9609_ab627589e7fc.slice/crio-ebbc9efa877f53791d45da19a181cc6eb032cb601e833cae742ccd20a05a4f4d WatchSource:0}: Error finding container ebbc9efa877f53791d45da19a181cc6eb032cb601e833cae742ccd20a05a4f4d: Status 404 returned error can't find the container with id ebbc9efa877f53791d45da19a181cc6eb032cb601e833cae742ccd20a05a4f4d Jun 03 23:03:11.365846 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:11.365676 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890cc999_5596_41e2_b811_6866c04be7f9.slice/crio-fd948074f2d9ded59d990c7e69e33379d3f49c1dd462cc8111d1ebd96f27fa48 WatchSource:0}: Error finding container fd948074f2d9ded59d990c7e69e33379d3f49c1dd462cc8111d1ebd96f27fa48: Status 404 returned error can't find the container with id fd948074f2d9ded59d990c7e69e33379d3f49c1dd462cc8111d1ebd96f27fa48 Jun 03 23:03:11.523245 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.523218 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:11.523321 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.523310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:11.523357 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.523345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:11.523390 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523368 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:11.523425 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523392 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-649b76b4c9-xp2p4: secret "image-registry-tls" not found Jun 03 23:03:11.523460 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523437 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:11.523498 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523462 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls podName:36ce1586-40d8-4e0d-9d3b-95153d5d5048 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.523442467 +0000 UTC m=+38.161535224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls") pod "image-registry-649b76b4c9-xp2p4" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048") : secret "image-registry-tls" not found Jun 03 23:03:11.523498 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523472 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:03:11.523498 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523479 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls podName:7dec70f7-b883-4149-82ea-c48d0b02ad1a nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.523468172 +0000 UTC m=+38.161560910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhfnx" (UID: "7dec70f7-b883-4149-82ea-c48d0b02ad1a") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:11.523609 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.523514 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls podName:527a2086-5893-4b12-a688-62ae8637aca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.523500469 +0000 UTC m=+38.161593196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-4lt64" (UID: "527a2086-5893-4b12-a688-62ae8637aca6") : secret "samples-operator-tls" not found Jun 03 23:03:11.624523 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.624487 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:11.624710 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.624680 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:03:11.624806 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.624770 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert podName:49f30332-91b0-41a7-b40a-4b54c668c69b nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.624748242 +0000 UTC m=+38.262840982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-nkf2l" (UID: "49f30332-91b0-41a7-b40a-4b54c668c69b") : secret "networking-console-plugin-cert" not found Jun 03 23:03:11.725700 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.725639 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.725738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:11.725861 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.725883 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.725863327 +0000 UTC m=+38.363956072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : configmap references non-existent config key: service-ca.crt Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.725947 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.725961 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.725992 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.725979942 +0000 UTC m=+38.364072682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : secret "router-metrics-certs-default" not found Jun 03 23:03:11.726449 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:11.726031 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls podName:d608acf6-e9d4-493d-82f8-bcc5ee9106f9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.726011511 +0000 UTC m=+38.364104237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls") pod "dns-default-pz9vg" (UID: "d608acf6-e9d4-493d-82f8-bcc5ee9106f9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:12.043607 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.043513 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fkq6s" event={"ID":"b32101c5-6407-4b0b-8795-f985fd873544","Type":"ContainerStarted","Data":"b26ff927fb9373f99d93fe31d2d80f1cc47a0fad97d419cf2df33597dbd89e48"} Jun 03 23:03:12.046461 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.046432 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" event={"ID":"8dbc20d5-2bcf-47b3-86d0-9cd73832f899","Type":"ContainerStarted","Data":"0088f7ce72a0b8623a3422bc18946d675af6fc053ec0d3aa7dc9b7f703f06b3e"} Jun 03 23:03:12.049440 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.049398 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" event={"ID":"890cc999-5596-41e2-b811-6866c04be7f9","Type":"ContainerStarted","Data":"fd948074f2d9ded59d990c7e69e33379d3f49c1dd462cc8111d1ebd96f27fa48"} Jun 03 23:03:12.051097 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.051069 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" event={"ID":"1c62a181-9541-49a9-968a-0a3fe29ef5fb","Type":"ContainerStarted","Data":"af4e514c5a2c6c0618ae376013d73ee9e3511e8f10e895fd048ccedabe5a676c"} Jun 03 23:03:12.053581 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.053556 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" event={"ID":"9c575b89-b1a3-4565-a3b3-e99847a93e57","Type":"ContainerStarted","Data":"c34637eef25e1af1d8c8b14402939b529a7dc1eff83396635d64bc64f8864b57"} Jun 03 23:03:12.061310 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.061282 2552 generic.go:356] "Generic (PLEG): container finished" podID="55099152-e89d-4922-85b8-42c1469d3c30" containerID="7fe4f003d09406243a8d8f4d924fe51f06f94ece276c08ac49cbbb77949a5093" exitCode=0 Jun 03 23:03:12.061452 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.061373 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerDied","Data":"7fe4f003d09406243a8d8f4d924fe51f06f94ece276c08ac49cbbb77949a5093"} Jun 03 23:03:12.064629 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.064604 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-5bb94" event={"ID":"0d79e31f-a188-4619-96e6-8c24e88d8956","Type":"ContainerStarted","Data":"dab24bca3e8cbfe6adc411c7506221e55e4d8f767e12a18ab76a1f4def3c2bdb"} Jun 03 23:03:12.067533 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:12.067467 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" event={"ID":"6564a1bc-b4a8-4a8b-9609-ab627589e7fc","Type":"ContainerStarted","Data":"ebbc9efa877f53791d45da19a181cc6eb032cb601e833cae742ccd20a05a4f4d"} Jun 03 23:03:13.081900 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.081862 2552 generic.go:356] "Generic (PLEG): container finished" podID="55099152-e89d-4922-85b8-42c1469d3c30" containerID="e6aea046e24c8c22f8b727da22aab88ff6646a608be997d4a37853d811781881" exitCode=0 Jun 03 23:03:13.082346 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.081972 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerDied","Data":"e6aea046e24c8c22f8b727da22aab88ff6646a608be997d4a37853d811781881"} Jun 03 23:03:13.546747 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.546695 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:13.546927 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.546787 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:13.546927 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.546887 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:13.547045 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.546971 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls podName:7dec70f7-b883-4149-82ea-c48d0b02ad1a nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.546949252 +0000 UTC m=+42.185042001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhfnx" (UID: "7dec70f7-b883-4149-82ea-c48d0b02ad1a") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:13.547045 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.546981 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:13.547045 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.546984 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:03:13.547045 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.546996 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-649b76b4c9-xp2p4: secret "image-registry-tls" not found Jun 03 23:03:13.547045 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.546893 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:13.547045 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.547047 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls podName:527a2086-5893-4b12-a688-62ae8637aca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.547030316 +0000 UTC m=+42.185123059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-4lt64" (UID: "527a2086-5893-4b12-a688-62ae8637aca6") : secret "samples-operator-tls" not found Jun 03 23:03:13.547414 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.547081 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls podName:36ce1586-40d8-4e0d-9d3b-95153d5d5048 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.547070205 +0000 UTC m=+42.185162936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls") pod "image-registry-649b76b4c9-xp2p4" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048") : secret "image-registry-tls" not found Jun 03 23:03:13.648395 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.647753 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:13.648395 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.647931 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:03:13.648395 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.647998 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert podName:49f30332-91b0-41a7-b40a-4b54c668c69b nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.647979646 +0000 UTC m=+42.286072396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-nkf2l" (UID: "49f30332-91b0-41a7-b40a-4b54c668c69b") : secret "networking-console-plugin-cert" not found Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.748865 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.748960 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:13.749004 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.749244 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.749309 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls podName:d608acf6-e9d4-493d-82f8-bcc5ee9106f9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.749289784 +0000 UTC m=+42.387382527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls") pod "dns-default-pz9vg" (UID: "d608acf6-e9d4-493d-82f8-bcc5ee9106f9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.749761 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.749817 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.749801259 +0000 UTC m=+42.387894005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : secret "router-metrics-certs-default" not found Jun 03 23:03:13.749973 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:13.749885 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.749875176 +0000 UTC m=+42.387967907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : configmap references non-existent config key: service-ca.crt Jun 03 23:03:14.090265 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:14.090158 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjj52" event={"ID":"55099152-e89d-4922-85b8-42c1469d3c30","Type":"ContainerStarted","Data":"84652eea5b81d70cb9c680b6f34f7582580781ed7047acdd9c858af1904eafd3"} Jun 03 23:03:14.092087 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:14.092061 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" event={"ID":"1c62a181-9541-49a9-968a-0a3fe29ef5fb","Type":"ContainerStarted","Data":"4cf06f31666bbe54feb659e703fe862f079f87294c9cb0f72ed1822fc435ad23"} Jun 03 23:03:14.113540 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:14.113472 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wjj52" podStartSLOduration=7.837767478 podStartE2EDuration="38.113450371s" totalImagesPullingTime="30.275682893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:14.112022215 +0000 UTC m=+38.750114966" watchObservedRunningTime="2026-06-03 23:03:14.113450371 +0000 UTC m=+38.751543120" Jun 03 23:03:14.129715 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:14.129535 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c6lnq" podStartSLOduration=33.185215045 podStartE2EDuration="35.129517091s" totalImagesPullingTime="1.944302046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:14.129231043 +0000 UTC m=+38.767323790" watchObservedRunningTime="2026-06-03 23:03:14.129517091 +0000 UTC m=+38.767609838" Jun 03 23:03:17.585602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.585556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.585624 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.585738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585751 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585763 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585817 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls podName:7dec70f7-b883-4149-82ea-c48d0b02ad1a nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.585799175 +0000 UTC m=+50.223891912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhfnx" (UID: "7dec70f7-b883-4149-82ea-c48d0b02ad1a") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585837 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls podName:527a2086-5893-4b12-a688-62ae8637aca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.585826934 +0000 UTC m=+50.223919664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-4lt64" (UID: "527a2086-5893-4b12-a688-62ae8637aca6") : secret "samples-operator-tls" not found Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585863 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585875 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-649b76b4c9-xp2p4: secret "image-registry-tls" not found Jun 03 23:03:17.586173 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.585916 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls podName:36ce1586-40d8-4e0d-9d3b-95153d5d5048 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.58590597 +0000 UTC m=+50.223998697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls") pod "image-registry-649b76b4c9-xp2p4" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048") : secret "image-registry-tls" not found Jun 03 23:03:17.686371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.686333 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:17.686563 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.686515 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:03:17.686625 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.686593 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert podName:49f30332-91b0-41a7-b40a-4b54c668c69b nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.686574679 +0000 UTC m=+50.324667421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-nkf2l" (UID: "49f30332-91b0-41a7-b40a-4b54c668c69b") : secret "networking-console-plugin-cert" not found Jun 03 23:03:17.787193 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.787159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:17.787385 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.787327 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:03:17.787460 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.787393 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.78737758 +0000 UTC m=+50.425470306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : secret "router-metrics-certs-default" not found Jun 03 23:03:17.787460 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.787414 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.787404729 +0000 UTC m=+50.425497455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : configmap references non-existent config key: service-ca.crt Jun 03 23:03:17.787460 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.787330 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:17.787609 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:17.787478 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:17.787688 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.787611 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:17.787743 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:17.787695 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls podName:d608acf6-e9d4-493d-82f8-bcc5ee9106f9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:25.787681545 +0000 UTC m=+50.425774271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls") pod "dns-default-pz9vg" (UID: "d608acf6-e9d4-493d-82f8-bcc5ee9106f9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:19.117383 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.117339 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" event={"ID":"9c575b89-b1a3-4565-a3b3-e99847a93e57","Type":"ContainerStarted","Data":"52e8bae3b88d14165f859adc32f5eed32f44cc398dd06b79d95adc8276a206e6"} Jun 03 23:03:19.119288 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.119253 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-5bb94" event={"ID":"0d79e31f-a188-4619-96e6-8c24e88d8956","Type":"ContainerStarted","Data":"99b96d8d49f3f4269e5d3e62bb84dca4e78c4dca249b3bcc652e9b3e156cb644"} Jun 03 23:03:19.120929 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.120902 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" event={"ID":"6564a1bc-b4a8-4a8b-9609-ab627589e7fc","Type":"ContainerStarted","Data":"50f752840d21a0859751e829dcc8f368d73a019d2a05251912b454849ede928f"} Jun 03 23:03:19.122884 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.122858 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fkq6s" event={"ID":"b32101c5-6407-4b0b-8795-f985fd873544","Type":"ContainerStarted","Data":"155bb719d3de2e36ad749bea2726333f83a40169d8a0e3f2054981b0f30e592f"} Jun 03 23:03:19.124725 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.124703 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/0.log" Jun 03 23:03:19.124823 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.124748 2552 generic.go:356] "Generic (PLEG): container finished" podID="8dbc20d5-2bcf-47b3-86d0-9cd73832f899" containerID="f29872eb012dd2971540c471f75179964b27e8aafd8c8bc86164641ed119680e" exitCode=255 Jun 03 23:03:19.124881 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.124827 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" event={"ID":"8dbc20d5-2bcf-47b3-86d0-9cd73832f899","Type":"ContainerDied","Data":"f29872eb012dd2971540c471f75179964b27e8aafd8c8bc86164641ed119680e"} Jun 03 23:03:19.125026 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.125002 2552 scope.go:117] "RemoveContainer" containerID="f29872eb012dd2971540c471f75179964b27e8aafd8c8bc86164641ed119680e" Jun 03 23:03:19.126330 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.126309 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" event={"ID":"890cc999-5596-41e2-b811-6866c04be7f9","Type":"ContainerStarted","Data":"da404ee3f2adf977ac44237ab30dbffe684465abe34f7f3d9ac9d9b1e3eeb17a"} Jun 03 23:03:19.134796 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.134220 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7r55r" podStartSLOduration=33.140131788 podStartE2EDuration="40.134202857s" totalImagesPullingTime="6.994071069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:19.133028009 +0000 UTC m=+43.771120758" watchObservedRunningTime="2026-06-03 23:03:19.134202857 +0000 UTC m=+43.772295603" Jun 03 23:03:19.149698 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.149632 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" podStartSLOduration=33.176052147 podStartE2EDuration="40.149611058s" totalImagesPullingTime="6.973558911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:19.147898251 +0000 UTC m=+43.785990997" watchObservedRunningTime="2026-06-03 23:03:19.149611058 +0000 UTC m=+43.787703808" Jun 03 23:03:19.169107 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.168537 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-5bb94" podStartSLOduration=33.181955 podStartE2EDuration="40.168519279s" totalImagesPullingTime="6.986564279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:19.1667138 +0000 UTC m=+43.804806546" watchObservedRunningTime="2026-06-03 23:03:19.168519279 +0000 UTC m=+43.806612010" Jun 03 23:03:19.202273 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.202216 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fkq6s" podStartSLOduration=3.216235517 podStartE2EDuration="10.202194011s" totalImagesPullingTime="6.985958494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:19.20036567 +0000 UTC m=+43.838458412" watchObservedRunningTime="2026-06-03 23:03:19.202194011 +0000 UTC m=+43.840286763" Jun 03 23:03:19.219733 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:19.219617 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" podStartSLOduration=33.245745892 podStartE2EDuration="40.219592538s" totalImagesPullingTime="6.973846646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:19.217919134 +0000 UTC m=+43.856011883" watchObservedRunningTime="2026-06-03 23:03:19.219592538 +0000 UTC m=+43.857685287" Jun 03 23:03:20.131227 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.131194 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:03:20.131709 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.131694 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/0.log" Jun 03 23:03:20.131765 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.131728 2552 generic.go:356] "Generic (PLEG): container finished" podID="8dbc20d5-2bcf-47b3-86d0-9cd73832f899" containerID="545cbe198e8fc16bd48a79d86378efbf461d6eaea0d8bf628b6de488318c307a" exitCode=255 Jun 03 23:03:20.131850 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.131820 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" event={"ID":"8dbc20d5-2bcf-47b3-86d0-9cd73832f899","Type":"ContainerDied","Data":"545cbe198e8fc16bd48a79d86378efbf461d6eaea0d8bf628b6de488318c307a"} Jun 03 23:03:20.131981 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.131887 2552 scope.go:117] "RemoveContainer" containerID="f29872eb012dd2971540c471f75179964b27e8aafd8c8bc86164641ed119680e" Jun 03 23:03:20.132146 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.132105 2552 scope.go:117] "RemoveContainer" containerID="545cbe198e8fc16bd48a79d86378efbf461d6eaea0d8bf628b6de488318c307a" Jun 03 23:03:20.132309 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:20.132287 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-pzc9r_openshift-console-operator(8dbc20d5-2bcf-47b3-86d0-9cd73832f899)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" podUID="8dbc20d5-2bcf-47b3-86d0-9cd73832f899" Jun 03 23:03:20.254436 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.254402 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:20.254598 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:20.254454 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:21.137306 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:21.137280 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:03:21.137816 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:21.137721 2552 scope.go:117] "RemoveContainer" containerID="545cbe198e8fc16bd48a79d86378efbf461d6eaea0d8bf628b6de488318c307a" Jun 03 23:03:21.137937 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:21.137915 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-pzc9r_openshift-console-operator(8dbc20d5-2bcf-47b3-86d0-9cd73832f899)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" podUID="8dbc20d5-2bcf-47b3-86d0-9cd73832f899" Jun 03 23:03:21.635686 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:21.635639 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rccsq_d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3/dns-node-resolver/0.log" Jun 03 23:03:22.140432 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:22.140405 2552 scope.go:117] "RemoveContainer" containerID="545cbe198e8fc16bd48a79d86378efbf461d6eaea0d8bf628b6de488318c307a" Jun 03 23:03:22.140837 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:22.140563 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-pzc9r_openshift-console-operator(8dbc20d5-2bcf-47b3-86d0-9cd73832f899)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" podUID="8dbc20d5-2bcf-47b3-86d0-9cd73832f899" Jun 03 23:03:22.441115 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:22.441043 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fw9vj_4947f5bc-89b0-4d81-be6d-981aaef111fc/node-ca/0.log" Jun 03 23:03:23.235951 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:23.235922 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fkq6s_b32101c5-6407-4b0b-8795-f985fd873544/serve-healthcheck-canary/0.log" Jun 03 23:03:25.655523 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.655487 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.655677 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655714 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.655773 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655788 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655796 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls podName:527a2086-5893-4b12-a688-62ae8637aca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.655773616 +0000 UTC m=+66.293866365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-4lt64" (UID: "527a2086-5893-4b12-a688-62ae8637aca6") : secret "samples-operator-tls" not found Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655801 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-649b76b4c9-xp2p4: secret "image-registry-tls" not found Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655832 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655840 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls podName:36ce1586-40d8-4e0d-9d3b-95153d5d5048 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.655829197 +0000 UTC m=+66.293921923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls") pod "image-registry-649b76b4c9-xp2p4" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048") : secret "image-registry-tls" not found Jun 03 23:03:25.656009 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.655877 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls podName:7dec70f7-b883-4149-82ea-c48d0b02ad1a nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.655864399 +0000 UTC m=+66.293957127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhfnx" (UID: "7dec70f7-b883-4149-82ea-c48d0b02ad1a") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:03:25.756775 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.756737 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:25.756960 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.756867 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:03:25.756960 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.756931 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert podName:49f30332-91b0-41a7-b40a-4b54c668c69b nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.756915411 +0000 UTC m=+66.395008137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-nkf2l" (UID: "49f30332-91b0-41a7-b40a-4b54c668c69b") : secret "networking-console-plugin-cert" not found Jun 03 23:03:25.857349 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.857305 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:25.857543 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.857360 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:25.857543 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:25.857420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:25.857543 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.857469 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.857456221 +0000 UTC m=+66.495548947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : configmap references non-existent config key: service-ca.crt Jun 03 23:03:25.857543 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.857515 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:25.857777 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.857554 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls podName:d608acf6-e9d4-493d-82f8-bcc5ee9106f9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.85754299 +0000 UTC m=+66.495635715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls") pod "dns-default-pz9vg" (UID: "d608acf6-e9d4-493d-82f8-bcc5ee9106f9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:25.857777 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.857596 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:03:25.857777 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:25.857681 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs podName:798d3498-5713-473b-a7b8-ad5e9fe6f658 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:41.857641012 +0000 UTC m=+66.495733754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs") pod "router-default-7c989f8d7c-7z85d" (UID: "798d3498-5713-473b-a7b8-ad5e9fe6f658") : secret "router-metrics-certs-default" not found Jun 03 23:03:33.814252 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:33.814212 2552 scope.go:117] "RemoveContainer" containerID="545cbe198e8fc16bd48a79d86378efbf461d6eaea0d8bf628b6de488318c307a" Jun 03 23:03:34.180246 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:34.180216 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:03:34.180496 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:34.180281 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" event={"ID":"8dbc20d5-2bcf-47b3-86d0-9cd73832f899","Type":"ContainerStarted","Data":"03251e1bc4ae51897143aa6147f76040601d95048516cad5a6c51cd5b974ab85"} Jun 03 23:03:34.180609 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:34.180588 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:34.197318 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:34.197265 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" podStartSLOduration=48.211929794 podStartE2EDuration="55.197249457s" totalImagesPullingTime="6.985319663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:34.196206474 +0000 UTC m=+58.834299222" watchObservedRunningTime="2026-06-03 23:03:34.197249457 +0000 UTC m=+58.835342207" Jun 03 23:03:35.006278 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:35.006249 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-pzc9r" Jun 03 23:03:36.030515 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:36.030485 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdpr7" Jun 03 23:03:40.586353 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.586298 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:40.588661 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.588634 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:03:40.600993 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.600962 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d-metrics-certs\") pod \"network-metrics-daemon-6l7xg\" (UID: \"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d\") " pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:40.687323 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.687284 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:40.687323 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.687323 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:40.689793 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.689762 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:03:40.689948 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.689930 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnjt\" (UniqueName: \"kubernetes.io/projected/c968e010-6e95-4a9f-9301-d257c47c5b48-kube-api-access-4jnjt\") pod \"network-check-target-rgfjc\" (UID: \"c968e010-6e95-4a9f-9301-d257c47c5b48\") " pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:40.700399 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.700370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d71ee51b-4b7e-43db-b863-8fef4edf3c04-original-pull-secret\") pod \"global-pull-secret-syncer-z4ld4\" (UID: \"d71ee51b-4b7e-43db-b863-8fef4edf3c04\") " pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:40.775279 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.775245 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skdgk\"" Jun 03 23:03:40.781010 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.780987 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-256x8\"" Jun 03 23:03:40.783956 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.783929 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6l7xg" Jun 03 23:03:40.790064 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.790045 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:40.824480 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.824440 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4ld4" Jun 03 23:03:40.930433 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.930343 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6l7xg"] Jun 03 23:03:40.932705 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:40.932669 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee8cfd4f_ab88_4ba0_a61f_d8ca4380c78d.slice/crio-9160bd34ca3ab38e3c074a78233a8d912b7829f05cdfe5131a8cddfac5ecae8c WatchSource:0}: Error finding container 9160bd34ca3ab38e3c074a78233a8d912b7829f05cdfe5131a8cddfac5ecae8c: Status 404 returned error can't find the container with id 9160bd34ca3ab38e3c074a78233a8d912b7829f05cdfe5131a8cddfac5ecae8c Jun 03 23:03:40.946688 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.946638 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rgfjc"] Jun 03 23:03:40.950396 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:40.950370 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc968e010_6e95_4a9f_9301_d257c47c5b48.slice/crio-cd9bcc8e8fddd74af0d972a68f09c7984c05a529d9f0be33ebaf5233b3bc1115 WatchSource:0}: Error finding container cd9bcc8e8fddd74af0d972a68f09c7984c05a529d9f0be33ebaf5233b3bc1115: Status 404 returned error can't find the container with id cd9bcc8e8fddd74af0d972a68f09c7984c05a529d9f0be33ebaf5233b3bc1115 Jun 03 23:03:40.976847 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:40.976820 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4ld4"] Jun 03 23:03:40.986772 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:40.986742 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71ee51b_4b7e_43db_b863_8fef4edf3c04.slice/crio-1caca79856730fb4765a170394ff8e9b4cf7786e24f01e0f3a3ac81b0243c918 WatchSource:0}: Error finding container 1caca79856730fb4765a170394ff8e9b4cf7786e24f01e0f3a3ac81b0243c918: Status 404 returned error can't find the container with id 1caca79856730fb4765a170394ff8e9b4cf7786e24f01e0f3a3ac81b0243c918 Jun 03 23:03:41.203225 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.203130 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4ld4" event={"ID":"d71ee51b-4b7e-43db-b863-8fef4edf3c04","Type":"ContainerStarted","Data":"1caca79856730fb4765a170394ff8e9b4cf7786e24f01e0f3a3ac81b0243c918"} Jun 03 23:03:41.204201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.204165 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6l7xg" event={"ID":"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d","Type":"ContainerStarted","Data":"9160bd34ca3ab38e3c074a78233a8d912b7829f05cdfe5131a8cddfac5ecae8c"} Jun 03 23:03:41.205377 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.205355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rgfjc" event={"ID":"c968e010-6e95-4a9f-9301-d257c47c5b48","Type":"ContainerStarted","Data":"a8b36561a343361200f9e5a2476e89fa2361b451c3094e7cff7bf06d65696ed3"} Jun 03 23:03:41.205531 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.205395 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rgfjc" event={"ID":"c968e010-6e95-4a9f-9301-d257c47c5b48","Type":"ContainerStarted","Data":"cd9bcc8e8fddd74af0d972a68f09c7984c05a529d9f0be33ebaf5233b3bc1115"} Jun 03 23:03:41.205531 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.205496 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:03:41.222023 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.221974 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rgfjc" podStartSLOduration=66.221959236 podStartE2EDuration="1m6.221959236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:41.220842768 +0000 UTC m=+65.858935527" watchObservedRunningTime="2026-06-03 23:03:41.221959236 +0000 UTC m=+65.860051962" Jun 03 23:03:41.696400 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.696358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:41.696933 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.696432 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:41.696933 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.696497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:41.699416 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.699389 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dec70f7-b883-4149-82ea-c48d0b02ad1a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhfnx\" (UID: \"7dec70f7-b883-4149-82ea-c48d0b02ad1a\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:41.699416 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.699407 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"image-registry-649b76b4c9-xp2p4\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:41.699587 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.699413 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/527a2086-5893-4b12-a688-62ae8637aca6-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-4lt64\" (UID: \"527a2086-5893-4b12-a688-62ae8637aca6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:41.798137 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.798097 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:41.800988 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.800958 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/49f30332-91b0-41a7-b40a-4b54c668c69b-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-nkf2l\" (UID: \"49f30332-91b0-41a7-b40a-4b54c668c69b\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:41.892278 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.892257 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7j6tg\"" Jun 03 23:03:41.898944 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.898897 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:41.899063 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.898950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:41.899063 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.899027 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:41.899745 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.899706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798d3498-5713-473b-a7b8-ad5e9fe6f658-service-ca-bundle\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:41.900821 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.900797 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" Jun 03 23:03:41.902231 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.902138 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/798d3498-5713-473b-a7b8-ad5e9fe6f658-metrics-certs\") pod \"router-default-7c989f8d7c-7z85d\" (UID: \"798d3498-5713-473b-a7b8-ad5e9fe6f658\") " pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:41.902747 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.902728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d608acf6-e9d4-493d-82f8-bcc5ee9106f9-metrics-tls\") pod \"dns-default-pz9vg\" (UID: \"d608acf6-e9d4-493d-82f8-bcc5ee9106f9\") " pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:41.946316 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.946285 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-thnx6\"" Jun 03 23:03:41.954760 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.954437 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" Jun 03 23:03:41.977970 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.977448 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gw87n\"" Jun 03 23:03:41.977970 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:41.977752 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:42.019287 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.019044 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-txjm4\"" Jun 03 23:03:42.028509 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.028049 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" Jun 03 23:03:42.077971 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.077872 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2gws\"" Jun 03 23:03:42.085546 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.085237 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:42.115027 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.113718 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8bx9k\"" Jun 03 23:03:42.115996 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.115913 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx"] Jun 03 23:03:42.121691 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.117825 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:42.164752 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.164607 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64"] Jun 03 23:03:42.197175 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.195849 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649b76b4c9-xp2p4"] Jun 03 23:03:42.218718 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.218687 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6l7xg" event={"ID":"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d","Type":"ContainerStarted","Data":"69f0f4d1093020c95404f672a1046a0d114e0bf5985dec703fcc84480af5efeb"} Jun 03 23:03:42.218863 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.218749 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6l7xg" event={"ID":"ee8cfd4f-ab88-4ba0-a61f-d8ca4380c78d","Type":"ContainerStarted","Data":"c790e6d02cf1b7939d94fca77c19af29ed9d84bc0ba170d6e8ac4ea3da5211c5"} Jun 03 23:03:42.220744 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.220715 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" event={"ID":"7dec70f7-b883-4149-82ea-c48d0b02ad1a","Type":"ContainerStarted","Data":"46f1a9e76756f7403bbc381d7d3fa72df5f3a0a3574721eb858cb3e309b4f469"} Jun 03 23:03:42.223181 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.223101 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" event={"ID":"36ce1586-40d8-4e0d-9d3b-95153d5d5048","Type":"ContainerStarted","Data":"f16f0604fc19d38fb233680188012ddd205b0514128dd2b3b9d5bd3215885cdc"} Jun 03 23:03:42.233437 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.233266 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-nkf2l"] Jun 03 23:03:42.236994 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:42.236955 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f30332_91b0_41a7_b40a_4b54c668c69b.slice/crio-2e039e953f4f553d3602145736ca4d914c3b2fc67102dded19f44bef73efd04d WatchSource:0}: Error finding container 2e039e953f4f553d3602145736ca4d914c3b2fc67102dded19f44bef73efd04d: Status 404 returned error can't find the container with id 2e039e953f4f553d3602145736ca4d914c3b2fc67102dded19f44bef73efd04d Jun 03 23:03:42.241715 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.241641 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6l7xg" podStartSLOduration=65.398389259 podStartE2EDuration="1m6.241618993s" totalImagesPullingTime="843.229734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:42.239576376 +0000 UTC m=+66.877669124" watchObservedRunningTime="2026-06-03 23:03:42.241618993 +0000 UTC m=+66.879711742" Jun 03 23:03:42.303969 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.303498 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pz9vg"] Jun 03 23:03:42.307238 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:42.307205 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd608acf6_e9d4_493d_82f8_bcc5ee9106f9.slice/crio-ef4cb68548db1db36174d5849493a3058d6c7ab67b448ca37e0b9ab0bbac097e WatchSource:0}: Error finding container ef4cb68548db1db36174d5849493a3058d6c7ab67b448ca37e0b9ab0bbac097e: Status 404 returned error can't find the container with id ef4cb68548db1db36174d5849493a3058d6c7ab67b448ca37e0b9ab0bbac097e Jun 03 23:03:42.325393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:42.325366 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c989f8d7c-7z85d"] Jun 03 23:03:42.328100 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:42.328054 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798d3498_5713_473b_a7b8_ad5e9fe6f658.slice/crio-78b195ef9545823fc139fa6e26d7e2a20379f5d57cb01062b1adc3e29bf8631d WatchSource:0}: Error finding container 78b195ef9545823fc139fa6e26d7e2a20379f5d57cb01062b1adc3e29bf8631d: Status 404 returned error can't find the container with id 78b195ef9545823fc139fa6e26d7e2a20379f5d57cb01062b1adc3e29bf8631d Jun 03 23:03:43.069668 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.069614 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv"] Jun 03 23:03:43.077089 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.075094 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.078947 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.078918 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 23:03:43.079217 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.079197 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 23:03:43.085201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.079494 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 23:03:43.085201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.079736 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 23:03:43.085201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.081347 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 23:03:43.085201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.081547 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 23:03:43.085201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.081777 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 23:03:43.093140 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.093062 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv"] Jun 03 23:03:43.111117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.110805 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.111117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.110878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j54l\" (UniqueName: \"kubernetes.io/projected/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-kube-api-access-2j54l\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.111117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.110924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-ca\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.111117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.110959 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-hub\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.111117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.110991 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.111117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.111019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.159320 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.157809 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dxs99"] Jun 03 23:03:43.160949 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.160688 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.163672 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.163604 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 23:03:43.164238 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.164028 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd8zh\"" Jun 03 23:03:43.165100 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.165049 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 23:03:43.177290 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.177205 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dxs99"] Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211537 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211571 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7skml\" (UniqueName: \"kubernetes.io/projected/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-kube-api-access-7skml\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211602 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211665 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j54l\" (UniqueName: \"kubernetes.io/projected/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-kube-api-access-2j54l\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211712 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-ca\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.212058 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.211738 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-crio-socket\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.213291 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.212598 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-hub\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.213291 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.212667 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.213291 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.212695 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-data-volume\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.213291 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.212721 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.214431 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.214372 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.217335 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.217266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.218452 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.218286 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.219701 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.219634 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-hub\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.223437 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.223194 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-ca\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.227221 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.226976 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j54l\" (UniqueName: \"kubernetes.io/projected/f8c00af9-7d32-40b3-8bfc-c6c7666a0305-kube-api-access-2j54l\") pod \"cluster-proxy-proxy-agent-74cc7648bc-t68bv\" (UID: \"f8c00af9-7d32-40b3-8bfc-c6c7666a0305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.232781 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.232511 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" event={"ID":"798d3498-5713-473b-a7b8-ad5e9fe6f658","Type":"ContainerStarted","Data":"85cfd0ffe47ab2921ffe0656b96de91d4be7caaf195f3d342ed4f219c8b0d18e"} Jun 03 23:03:43.232781 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.232575 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" event={"ID":"798d3498-5713-473b-a7b8-ad5e9fe6f658","Type":"ContainerStarted","Data":"78b195ef9545823fc139fa6e26d7e2a20379f5d57cb01062b1adc3e29bf8631d"} Jun 03 23:03:43.235818 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.235674 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" event={"ID":"36ce1586-40d8-4e0d-9d3b-95153d5d5048","Type":"ContainerStarted","Data":"5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e"} Jun 03 23:03:43.236805 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.236246 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:03:43.240817 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.240761 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" event={"ID":"527a2086-5893-4b12-a688-62ae8637aca6","Type":"ContainerStarted","Data":"c290257a70f7b1cb54d593d69fed85584e970db21ae67be8e264358faee90996"} Jun 03 23:03:43.243599 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.243531 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" event={"ID":"49f30332-91b0-41a7-b40a-4b54c668c69b","Type":"ContainerStarted","Data":"2e039e953f4f553d3602145736ca4d914c3b2fc67102dded19f44bef73efd04d"} Jun 03 23:03:43.245860 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.245779 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pz9vg" event={"ID":"d608acf6-e9d4-493d-82f8-bcc5ee9106f9","Type":"ContainerStarted","Data":"ef4cb68548db1db36174d5849493a3058d6c7ab67b448ca37e0b9ab0bbac097e"} Jun 03 23:03:43.273986 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.273239 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" podStartSLOduration=64.273213722 podStartE2EDuration="1m4.273213722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:43.271847245 +0000 UTC m=+67.909939996" watchObservedRunningTime="2026-06-03 23:03:43.273213722 +0000 UTC m=+67.911306453" Jun 03 23:03:43.314699 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.314001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.314699 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.314153 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-crio-socket\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.314699 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.314251 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-data-volume\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.314699 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.314350 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.314699 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.314423 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7skml\" (UniqueName: \"kubernetes.io/projected/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-kube-api-access-7skml\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.315102 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.315074 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-crio-socket\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.315162 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.315104 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-data-volume\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.316555 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.316498 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.319753 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.318728 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" podStartSLOduration=67.318710548 podStartE2EDuration="1m7.318710548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:43.316625552 +0000 UTC m=+67.954718302" watchObservedRunningTime="2026-06-03 23:03:43.318710548 +0000 UTC m=+67.956803298" Jun 03 23:03:43.322624 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.322575 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.333212 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.333128 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7skml\" (UniqueName: \"kubernetes.io/projected/e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1-kube-api-access-7skml\") pod \"insights-runtime-extractor-dxs99\" (UID: \"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1\") " pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.405609 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.405307 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" Jun 03 23:03:43.478845 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.478536 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dxs99" Jun 03 23:03:43.992815 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:43.992715 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dxs99"] Jun 03 23:03:44.025562 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.025337 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv"] Jun 03 23:03:44.118893 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.118839 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:44.122173 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.122133 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:44.252299 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.252216 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" event={"ID":"49f30332-91b0-41a7-b40a-4b54c668c69b","Type":"ContainerStarted","Data":"aacd486057ed99568796c9489130203bfe0971decceeb3f394205b21b8591d42"} Jun 03 23:03:44.252815 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.252714 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:44.254203 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.254178 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c989f8d7c-7z85d" Jun 03 23:03:44.271787 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:44.271522 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-nkf2l" podStartSLOduration=63.676808395 podStartE2EDuration="1m5.271503238s" totalImagesPullingTime="1.594694843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:44.269903614 +0000 UTC m=+68.907996362" watchObservedRunningTime="2026-06-03 23:03:44.271503238 +0000 UTC m=+68.909595985" Jun 03 23:03:44.523181 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:44.523139 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8c00af9_7d32_40b3_8bfc_c6c7666a0305.slice/crio-f9f1c73d708f679321daa1f115fa9b36e48bf77390946a776e38580dd3053f10 WatchSource:0}: Error finding container f9f1c73d708f679321daa1f115fa9b36e48bf77390946a776e38580dd3053f10: Status 404 returned error can't find the container with id f9f1c73d708f679321daa1f115fa9b36e48bf77390946a776e38580dd3053f10 Jun 03 23:03:44.524081 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:44.523853 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode878b2b2_e1c7_4a37_9b4e_0fe2a005e4d1.slice/crio-81e077934b2b357aa710171625886acc990c86f8cf2d70d2b4624041f327943a WatchSource:0}: Error finding container 81e077934b2b357aa710171625886acc990c86f8cf2d70d2b4624041f327943a: Status 404 returned error can't find the container with id 81e077934b2b357aa710171625886acc990c86f8cf2d70d2b4624041f327943a Jun 03 23:03:45.259023 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:45.258865 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" event={"ID":"f8c00af9-7d32-40b3-8bfc-c6c7666a0305","Type":"ContainerStarted","Data":"f9f1c73d708f679321daa1f115fa9b36e48bf77390946a776e38580dd3053f10"} Jun 03 23:03:45.261490 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:45.261445 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxs99" event={"ID":"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1","Type":"ContainerStarted","Data":"81e077934b2b357aa710171625886acc990c86f8cf2d70d2b4624041f327943a"} Jun 03 23:03:48.277544 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.277505 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pz9vg" event={"ID":"d608acf6-e9d4-493d-82f8-bcc5ee9106f9","Type":"ContainerStarted","Data":"f73ee2344597090b4669fd4de4db8aea88714e4c874de33ade435285c3a1bb45"} Jun 03 23:03:48.281420 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.280618 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4ld4" event={"ID":"d71ee51b-4b7e-43db-b863-8fef4edf3c04","Type":"ContainerStarted","Data":"08bd6039fda3498c399d172525c2972d3aed6a89b5e08549ffca536d4aa782cb"} Jun 03 23:03:48.287597 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.287556 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxs99" event={"ID":"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1","Type":"ContainerStarted","Data":"4d1a079aea6f6aa06c2da413ccee66ba911ab90ecb3d326ac0ad93d15f656f50"} Jun 03 23:03:48.292103 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.292075 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" event={"ID":"527a2086-5893-4b12-a688-62ae8637aca6","Type":"ContainerStarted","Data":"7e62e6b1be4060ea2bdace7273b34b684a1f0de839558df287646519d6c737fe"} Jun 03 23:03:48.292244 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.292124 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" event={"ID":"527a2086-5893-4b12-a688-62ae8637aca6","Type":"ContainerStarted","Data":"de6ea738a17bb6e10587f703d89d1e6cfcda189f47730a646218bfe58bbb2226"} Jun 03 23:03:48.294113 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.294091 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" event={"ID":"7dec70f7-b883-4149-82ea-c48d0b02ad1a","Type":"ContainerStarted","Data":"97868cc6455da5e4ebab1400d645c1eea03d8fac45e7fa10888d7186c3fd3ac9"} Jun 03 23:03:48.304316 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.304248 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z4ld4" podStartSLOduration=65.37997588 podStartE2EDuration="1m12.304225962s" totalImagesPullingTime="6.924250082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:48.303410161 +0000 UTC m=+72.941502909" watchObservedRunningTime="2026-06-03 23:03:48.304225962 +0000 UTC m=+72.942318709" Jun 03 23:03:48.325175 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.325115 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhfnx" podStartSLOduration=63.567105447 podStartE2EDuration="1m9.32509186s" totalImagesPullingTime="5.757986413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:48.322765604 +0000 UTC m=+72.960858376" watchObservedRunningTime="2026-06-03 23:03:48.32509186 +0000 UTC m=+72.963184608" Jun 03 23:03:48.341558 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:48.341017 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-4lt64" podStartSLOduration=63.692233546 podStartE2EDuration="1m9.340998586s" totalImagesPullingTime="5.64876504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:48.33958139 +0000 UTC m=+72.977674139" watchObservedRunningTime="2026-06-03 23:03:48.340998586 +0000 UTC m=+72.979091332" Jun 03 23:03:49.300789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:49.300691 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pz9vg" event={"ID":"d608acf6-e9d4-493d-82f8-bcc5ee9106f9","Type":"ContainerStarted","Data":"7953ae5adcdf69dc6ae7e1cb71aba791cb8b2742c0f66b50f69c284a9ff76052"} Jun 03 23:03:49.300789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:49.300775 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:49.302737 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:49.302709 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxs99" event={"ID":"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1","Type":"ContainerStarted","Data":"98746b79e31ea0a074c493f7d887ba2092d1da66281882bff9ceba5283572c9f"} Jun 03 23:03:49.319161 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:49.319104 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pz9vg" podStartSLOduration=34.73142654 podStartE2EDuration="40.319087863s" totalImagesPullingTime="5.587661323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:49.318289005 +0000 UTC m=+73.956381754" watchObservedRunningTime="2026-06-03 23:03:49.319087863 +0000 UTC m=+73.957180612" Jun 03 23:03:53.319888 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:53.319854 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxs99" event={"ID":"e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1","Type":"ContainerStarted","Data":"cec47775ce994fbc19536a21851a31fcaa2d92438efd03c83d58e0dbc4ac6628"} Jun 03 23:03:53.321871 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:53.321850 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" event={"ID":"f8c00af9-7d32-40b3-8bfc-c6c7666a0305","Type":"ContainerStarted","Data":"d0f621e2815f958d8bba2c90cabe71bacda360a711a10e993d82366a23704fff"} Jun 03 23:03:53.321935 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:53.321885 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" event={"ID":"f8c00af9-7d32-40b3-8bfc-c6c7666a0305","Type":"ContainerStarted","Data":"3e08313e90f4f9d84abc712e52f1ec4e4962d3769b3a2ced3b3d160b770e4ac6"} Jun 03 23:03:53.341876 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:53.341824 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dxs99" podStartSLOduration=5.438290044 podStartE2EDuration="10.341807206s" totalImagesPullingTime="4.903517162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:53.341338419 +0000 UTC m=+77.979431168" watchObservedRunningTime="2026-06-03 23:03:53.341807206 +0000 UTC m=+77.979899953" Jun 03 23:03:54.328084 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:54.328042 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" event={"ID":"f8c00af9-7d32-40b3-8bfc-c6c7666a0305","Type":"ContainerStarted","Data":"b9fe6b0bc7a4e0ecf1427d3f0fabdd5ceb8f9a7a143ca753bbb50b00e1af260f"} Jun 03 23:03:54.348662 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:54.348594 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cc7648bc-t68bv" podStartSLOduration=2.844321898 podStartE2EDuration="11.348576062s" totalImagesPullingTime="8.504254164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:54.346936579 +0000 UTC m=+78.985029339" watchObservedRunningTime="2026-06-03 23:03:54.348576062 +0000 UTC m=+78.986668809" Jun 03 23:03:58.009578 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.009542 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-srm2c"] Jun 03 23:03:58.012718 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.012688 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.015075 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.015047 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 23:03:58.015190 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.015166 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 23:03:58.015190 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.015183 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 23:03:58.015330 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.015315 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 23:03:58.015755 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.015741 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhwlr\"" Jun 03 23:03:58.147880 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.147831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.147897 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-tls\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.147942 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-textfile\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.147970 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dt8n\" (UniqueName: \"kubernetes.io/projected/205947be-b42d-437e-82dc-a83be3e4b0bc-kube-api-access-9dt8n\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.147999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-root\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.148015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205947be-b42d-437e-82dc-a83be3e4b0bc-metrics-client-ca\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148077 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.148054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-sys\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148292 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.148123 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-wtmp\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.148292 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.148158 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249262 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-sys\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249478 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249297 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-wtmp\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249478 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249326 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249478 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249354 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-sys\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249478 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249490 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-wtmp\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-tls\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-textfile\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:58.249575 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249584 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dt8n\" (UniqueName: \"kubernetes.io/projected/205947be-b42d-437e-82dc-a83be3e4b0bc-kube-api-access-9dt8n\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249612 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-root\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:03:58.249644 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-tls podName:205947be-b42d-437e-82dc-a83be3e4b0bc nodeName:}" failed. No retries permitted until 2026-06-03 23:03:58.749623009 +0000 UTC m=+83.387715749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-tls") pod "node-exporter-srm2c" (UID: "205947be-b42d-437e-82dc-a83be3e4b0bc") : secret "node-exporter-tls" not found Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249689 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/205947be-b42d-437e-82dc-a83be3e4b0bc-root\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.249732 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.249693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205947be-b42d-437e-82dc-a83be3e4b0bc-metrics-client-ca\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.250243 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.250208 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205947be-b42d-437e-82dc-a83be3e4b0bc-metrics-client-ca\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.250335 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.250220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.250393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.250376 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-textfile\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.252327 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.252306 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.261527 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.261454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dt8n\" (UniqueName: \"kubernetes.io/projected/205947be-b42d-437e-82dc-a83be3e4b0bc-kube-api-access-9dt8n\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.754691 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.754629 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-tls\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.756982 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.756953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205947be-b42d-437e-82dc-a83be3e4b0bc-node-exporter-tls\") pod \"node-exporter-srm2c\" (UID: \"205947be-b42d-437e-82dc-a83be3e4b0bc\") " pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.921663 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:58.921614 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srm2c" Jun 03 23:03:58.932985 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:03:58.932939 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205947be_b42d_437e_82dc_a83be3e4b0bc.slice/crio-ea356153fbdc73aee63b2e737989c9cede37674713b8dfd26f06aa0a736f26be WatchSource:0}: Error finding container ea356153fbdc73aee63b2e737989c9cede37674713b8dfd26f06aa0a736f26be: Status 404 returned error can't find the container with id ea356153fbdc73aee63b2e737989c9cede37674713b8dfd26f06aa0a736f26be Jun 03 23:03:59.309723 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:59.309689 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pz9vg" Jun 03 23:03:59.348367 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:03:59.348328 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srm2c" event={"ID":"205947be-b42d-437e-82dc-a83be3e4b0bc","Type":"ContainerStarted","Data":"ea356153fbdc73aee63b2e737989c9cede37674713b8dfd26f06aa0a736f26be"} Jun 03 23:04:00.353731 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:00.353699 2552 generic.go:356] "Generic (PLEG): container finished" podID="205947be-b42d-437e-82dc-a83be3e4b0bc" containerID="fa498f55fcce28581174e982d8b1c16bbc4c8ef1b983da87d1fa39db8b395cc4" exitCode=0 Jun 03 23:04:00.353731 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:00.353736 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srm2c" event={"ID":"205947be-b42d-437e-82dc-a83be3e4b0bc","Type":"ContainerDied","Data":"fa498f55fcce28581174e982d8b1c16bbc4c8ef1b983da87d1fa39db8b395cc4"} Jun 03 23:04:01.360059 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:01.360020 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srm2c" event={"ID":"205947be-b42d-437e-82dc-a83be3e4b0bc","Type":"ContainerStarted","Data":"fd6ed8e0b4f88df027f7aff8a1136a790d51c19cea9adda9c180ad693b0d9c0b"} Jun 03 23:04:01.360481 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:01.360112 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srm2c" event={"ID":"205947be-b42d-437e-82dc-a83be3e4b0bc","Type":"ContainerStarted","Data":"cf39cc207164b78d7185c788fe0451058694127a10b2e0dd74b476f037ecaa7a"} Jun 03 23:04:01.384196 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:01.384135 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-srm2c" podStartSLOduration=3.3452398629999998 podStartE2EDuration="4.384118765s" totalImagesPullingTime="968.476898ms" totalInitContainerRuntime="70.402004ms" isStatefulPod=true podCreationTimestamp="2026-06-03 23:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:01.382892584 +0000 UTC m=+86.020985350" watchObservedRunningTime="2026-06-03 23:04:01.384118765 +0000 UTC m=+86.022211513" Jun 03 23:04:04.996738 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:04.996700 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-649b76b4c9-xp2p4"] Jun 03 23:04:05.000996 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:05.000967 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:04:12.225793 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:12.225750 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rgfjc" Jun 03 23:04:25.449304 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:25.449268 2552 generic.go:356] "Generic (PLEG): container finished" podID="890cc999-5596-41e2-b811-6866c04be7f9" containerID="da404ee3f2adf977ac44237ab30dbffe684465abe34f7f3d9ac9d9b1e3eeb17a" exitCode=0 Jun 03 23:04:25.449785 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:25.449347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" event={"ID":"890cc999-5596-41e2-b811-6866c04be7f9","Type":"ContainerDied","Data":"da404ee3f2adf977ac44237ab30dbffe684465abe34f7f3d9ac9d9b1e3eeb17a"} Jun 03 23:04:25.449785 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:25.449697 2552 scope.go:117] "RemoveContainer" containerID="da404ee3f2adf977ac44237ab30dbffe684465abe34f7f3d9ac9d9b1e3eeb17a" Jun 03 23:04:26.455411 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:26.455377 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8" event={"ID":"890cc999-5596-41e2-b811-6866c04be7f9","Type":"ContainerStarted","Data":"d644361de2d7ec70ce6705142f7a7bd1f28cf2fe0a89d004bba6656d4c5f564f"} Jun 03 23:04:30.016721 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.016672 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" podUID="36ce1586-40d8-4e0d-9d3b-95153d5d5048" containerName="registry" containerID="cri-o://5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e" gracePeriod=30 Jun 03 23:04:30.261902 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.261875 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:04:30.305310 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305227 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305310 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305267 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36ce1586-40d8-4e0d-9d3b-95153d5d5048-ca-trust-extracted\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305310 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305293 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-bound-sa-token\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305569 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305323 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-trusted-ca\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305569 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305351 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-installation-pull-secrets\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305569 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305388 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-image-registry-private-configuration\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305569 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305443 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5px7b\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-kube-api-access-5px7b\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305820 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305794 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-certificates\") pod \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\" (UID: \"36ce1586-40d8-4e0d-9d3b-95153d5d5048\") " Jun 03 23:04:30.305991 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.305967 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:04:30.306106 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.306087 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-trusted-ca\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.306364 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.306340 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:04:30.308099 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.308033 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:04:30.308349 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.308311 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:04:30.308349 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.308324 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:04:30.308525 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.308388 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-kube-api-access-5px7b" (OuterVolumeSpecName: "kube-api-access-5px7b") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "kube-api-access-5px7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:04:30.308525 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.308456 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:04:30.314451 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.314421 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ce1586-40d8-4e0d-9d3b-95153d5d5048-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36ce1586-40d8-4e0d-9d3b-95153d5d5048" (UID: "36ce1586-40d8-4e0d-9d3b-95153d5d5048"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:04:30.406873 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406822 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5px7b\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-kube-api-access-5px7b\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.406873 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406868 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-certificates\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.406873 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406880 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-registry-tls\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.406873 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406890 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36ce1586-40d8-4e0d-9d3b-95153d5d5048-ca-trust-extracted\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.407130 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406898 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ce1586-40d8-4e0d-9d3b-95153d5d5048-bound-sa-token\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.407130 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406907 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-installation-pull-secrets\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.407130 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.406917 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36ce1586-40d8-4e0d-9d3b-95153d5d5048-image-registry-private-configuration\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:04:30.471556 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.471519 2552 generic.go:356] "Generic (PLEG): container finished" podID="36ce1586-40d8-4e0d-9d3b-95153d5d5048" containerID="5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e" exitCode=0 Jun 03 23:04:30.471755 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.471566 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" Jun 03 23:04:30.471755 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.471598 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" event={"ID":"36ce1586-40d8-4e0d-9d3b-95153d5d5048","Type":"ContainerDied","Data":"5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e"} Jun 03 23:04:30.471755 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.471637 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b76b4c9-xp2p4" event={"ID":"36ce1586-40d8-4e0d-9d3b-95153d5d5048","Type":"ContainerDied","Data":"f16f0604fc19d38fb233680188012ddd205b0514128dd2b3b9d5bd3215885cdc"} Jun 03 23:04:30.471755 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.471683 2552 scope.go:117] "RemoveContainer" containerID="5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e" Jun 03 23:04:30.480600 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.480582 2552 scope.go:117] "RemoveContainer" containerID="5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e" Jun 03 23:04:30.480889 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:04:30.480866 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e\": container with ID starting with 5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e not found: ID does not exist" containerID="5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e" Jun 03 23:04:30.480939 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.480897 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e"} err="failed to get container status \"5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e\": rpc error: code = NotFound desc = could not find container \"5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e\": container with ID starting with 5d355d928db9f63b9fd837d63316ff9a9307ae9df524cddfc28d4abf9e2b693e not found: ID does not exist" Jun 03 23:04:30.494733 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.494698 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-649b76b4c9-xp2p4"] Jun 03 23:04:30.497271 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:30.497249 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-649b76b4c9-xp2p4"] Jun 03 23:04:31.818412 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:31.818369 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ce1586-40d8-4e0d-9d3b-95153d5d5048" path="/var/lib/kubelet/pods/36ce1586-40d8-4e0d-9d3b-95153d5d5048/volumes" Jun 03 23:04:44.522176 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:44.522143 2552 generic.go:356] "Generic (PLEG): container finished" podID="0d79e31f-a188-4619-96e6-8c24e88d8956" containerID="99b96d8d49f3f4269e5d3e62bb84dca4e78c4dca249b3bcc652e9b3e156cb644" exitCode=0 Jun 03 23:04:44.522607 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:44.522201 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-5bb94" event={"ID":"0d79e31f-a188-4619-96e6-8c24e88d8956","Type":"ContainerDied","Data":"99b96d8d49f3f4269e5d3e62bb84dca4e78c4dca249b3bcc652e9b3e156cb644"} Jun 03 23:04:44.522607 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:44.522509 2552 scope.go:117] "RemoveContainer" containerID="99b96d8d49f3f4269e5d3e62bb84dca4e78c4dca249b3bcc652e9b3e156cb644" Jun 03 23:04:45.527466 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:45.527428 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-5bb94" event={"ID":"0d79e31f-a188-4619-96e6-8c24e88d8956","Type":"ContainerStarted","Data":"8d112c5153377c78f8d2593df049d07dac51698a98d77f9bc3497ea5678d41fc"} Jun 03 23:04:54.561477 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:54.561441 2552 generic.go:356] "Generic (PLEG): container finished" podID="6564a1bc-b4a8-4a8b-9609-ab627589e7fc" containerID="50f752840d21a0859751e829dcc8f368d73a019d2a05251912b454849ede928f" exitCode=0 Jun 03 23:04:54.561920 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:54.561502 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" event={"ID":"6564a1bc-b4a8-4a8b-9609-ab627589e7fc","Type":"ContainerDied","Data":"50f752840d21a0859751e829dcc8f368d73a019d2a05251912b454849ede928f"} Jun 03 23:04:54.561920 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:54.561845 2552 scope.go:117] "RemoveContainer" containerID="50f752840d21a0859751e829dcc8f368d73a019d2a05251912b454849ede928f" Jun 03 23:04:55.568124 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:04:55.568090 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-qbqls" event={"ID":"6564a1bc-b4a8-4a8b-9609-ab627589e7fc","Type":"ContainerStarted","Data":"bd87e6a04b63574c60c36f12d9f8423415a01ad9fb29b70f89978b182e79591d"} Jun 03 23:07:35.755231 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:07:35.755196 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:07:35.756459 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:07:35.756438 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:07:35.771939 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:07:35.771912 2552 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 23:08:23.477680 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.477584 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx"] Jun 03 23:08:23.478117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.477887 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ce1586-40d8-4e0d-9d3b-95153d5d5048" containerName="registry" Jun 03 23:08:23.478117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.477898 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ce1586-40d8-4e0d-9d3b-95153d5d5048" containerName="registry" Jun 03 23:08:23.478117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.477947 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ce1586-40d8-4e0d-9d3b-95153d5d5048" containerName="registry" Jun 03 23:08:23.480243 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.480226 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.487854 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.487833 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 23:08:23.489592 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.489518 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 23:08:23.489730 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.489715 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 23:08:23.491317 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.491301 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jt2zl\"" Jun 03 23:08:23.491481 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.491463 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 23:08:23.516925 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.516884 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx"] Jun 03 23:08:23.531672 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.531621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0114e740-b740-4dd2-ac53-b3f5e73738de-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.531821 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.531735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0114e740-b740-4dd2-ac53-b3f5e73738de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.531821 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.531768 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5gz\" (UniqueName: \"kubernetes.io/projected/0114e740-b740-4dd2-ac53-b3f5e73738de-kube-api-access-wg5gz\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.531821 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.531789 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0114e740-b740-4dd2-ac53-b3f5e73738de-tmp\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.531821 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.531808 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0114e740-b740-4dd2-ac53-b3f5e73738de-manifests\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.632462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.632424 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0114e740-b740-4dd2-ac53-b3f5e73738de-manifests\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.632681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.632502 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0114e740-b740-4dd2-ac53-b3f5e73738de-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.632681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.632540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0114e740-b740-4dd2-ac53-b3f5e73738de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.632681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.632558 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5gz\" (UniqueName: \"kubernetes.io/projected/0114e740-b740-4dd2-ac53-b3f5e73738de-kube-api-access-wg5gz\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.632681 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.632585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0114e740-b740-4dd2-ac53-b3f5e73738de-tmp\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.632949 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.632907 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0114e740-b740-4dd2-ac53-b3f5e73738de-manifests\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.634894 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.634871 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0114e740-b740-4dd2-ac53-b3f5e73738de-tmp\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.635111 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.635093 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0114e740-b740-4dd2-ac53-b3f5e73738de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.635153 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.635128 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0114e740-b740-4dd2-ac53-b3f5e73738de-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.640809 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.640784 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5gz\" (UniqueName: \"kubernetes.io/projected/0114e740-b740-4dd2-ac53-b3f5e73738de-kube-api-access-wg5gz\") pod \"opendatahub-operator-controller-manager-588c8dd987-pnqxx\" (UID: \"0114e740-b740-4dd2-ac53-b3f5e73738de\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.790117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.790032 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:23.926628 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.926575 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx"] Jun 03 23:08:23.928972 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:08:23.928940 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0114e740_b740_4dd2_ac53_b3f5e73738de.slice/crio-048aec72146a9622b230627aeeca6444af2bf2f5dbd6037dc3c9290b243b2be5 WatchSource:0}: Error finding container 048aec72146a9622b230627aeeca6444af2bf2f5dbd6037dc3c9290b243b2be5: Status 404 returned error can't find the container with id 048aec72146a9622b230627aeeca6444af2bf2f5dbd6037dc3c9290b243b2be5 Jun 03 23:08:23.930897 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:23.930877 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:08:24.340168 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:24.340133 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" event={"ID":"0114e740-b740-4dd2-ac53-b3f5e73738de","Type":"ContainerStarted","Data":"048aec72146a9622b230627aeeca6444af2bf2f5dbd6037dc3c9290b243b2be5"} Jun 03 23:08:27.354464 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:27.354424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" event={"ID":"0114e740-b740-4dd2-ac53-b3f5e73738de","Type":"ContainerStarted","Data":"759025d2005c04217edba7e65cf9dc87c3a0dc3bfebc7f461673641da37fb46c"} Jun 03 23:08:28.360177 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:28.360142 2552 generic.go:356] "Generic (PLEG): container finished" podID="0114e740-b740-4dd2-ac53-b3f5e73738de" containerID="759025d2005c04217edba7e65cf9dc87c3a0dc3bfebc7f461673641da37fb46c" exitCode=0 Jun 03 23:08:28.360569 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:28.360195 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" event={"ID":"0114e740-b740-4dd2-ac53-b3f5e73738de","Type":"ContainerDied","Data":"759025d2005c04217edba7e65cf9dc87c3a0dc3bfebc7f461673641da37fb46c"} Jun 03 23:08:29.366527 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:29.366487 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" event={"ID":"0114e740-b740-4dd2-ac53-b3f5e73738de","Type":"ContainerStarted","Data":"8119b434ea7a10cf30424d226e79016487f1f7b1b228d7b18eb925417a02a88e"} Jun 03 23:08:29.367038 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:29.366616 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:29.396790 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:29.396726 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" podStartSLOduration=2.181477219 podStartE2EDuration="6.396674778s" totalImagesPullingTime="3.299181587s" totalInitContainerRuntime="916.015972ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:29.395630973 +0000 UTC m=+354.033723714" watchObservedRunningTime="2026-06-03 23:08:29.396674778 +0000 UTC m=+354.034767526" Jun 03 23:08:40.373108 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:40.373076 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-pnqxx" Jun 03 23:08:43.517868 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.517832 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz"] Jun 03 23:08:43.527420 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.527386 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.530373 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.530354 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6w6jm\"" Jun 03 23:08:43.530498 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.530356 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 23:08:43.530498 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.530356 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 23:08:43.537696 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.537675 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz"] Jun 03 23:08:43.602608 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.602571 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b10fb-f935-4655-aa80-8a39866efd7e-tls-certs\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.602866 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.602690 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq44h\" (UniqueName: \"kubernetes.io/projected/e30b10fb-f935-4655-aa80-8a39866efd7e-kube-api-access-rq44h\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.602866 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.602734 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e30b10fb-f935-4655-aa80-8a39866efd7e-tmp\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.617492 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.617460 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-585fh"] Jun 03 23:08:43.619640 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.619624 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:43.621854 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.621835 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 23:08:43.621977 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.621837 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jd7g6\"" Jun 03 23:08:43.631286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.631261 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-585fh"] Jun 03 23:08:43.704194 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.704163 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b10fb-f935-4655-aa80-8a39866efd7e-tls-certs\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.704383 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.704211 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/627b6734-fb25-48c2-89ff-0a8a9d595143-cert\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:43.704383 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.704251 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5mh4\" (UniqueName: \"kubernetes.io/projected/627b6734-fb25-48c2-89ff-0a8a9d595143-kube-api-access-p5mh4\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:43.704383 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.704289 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq44h\" (UniqueName: \"kubernetes.io/projected/e30b10fb-f935-4655-aa80-8a39866efd7e-kube-api-access-rq44h\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.704383 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.704316 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e30b10fb-f935-4655-aa80-8a39866efd7e-tmp\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.706825 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.706798 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b10fb-f935-4655-aa80-8a39866efd7e-tls-certs\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.706945 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.706802 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e30b10fb-f935-4655-aa80-8a39866efd7e-tmp\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.712803 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.712766 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq44h\" (UniqueName: \"kubernetes.io/projected/e30b10fb-f935-4655-aa80-8a39866efd7e-kube-api-access-rq44h\") pod \"kube-auth-proxy-5cd4f89b79-754jz\" (UID: \"e30b10fb-f935-4655-aa80-8a39866efd7e\") " pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.804832 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.804739 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/627b6734-fb25-48c2-89ff-0a8a9d595143-cert\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:43.804832 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.804797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5mh4\" (UniqueName: \"kubernetes.io/projected/627b6734-fb25-48c2-89ff-0a8a9d595143-kube-api-access-p5mh4\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:43.805071 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:08:43.804864 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 23:08:43.805071 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:08:43.804982 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627b6734-fb25-48c2-89ff-0a8a9d595143-cert podName:627b6734-fb25-48c2-89ff-0a8a9d595143 nodeName:}" failed. No retries permitted until 2026-06-03 23:08:44.304953345 +0000 UTC m=+368.943046071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/627b6734-fb25-48c2-89ff-0a8a9d595143-cert") pod "odh-model-controller-6dc94f689f-585fh" (UID: "627b6734-fb25-48c2-89ff-0a8a9d595143") : secret "odh-model-controller-webhook-cert" not found Jun 03 23:08:43.821414 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.821379 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5mh4\" (UniqueName: \"kubernetes.io/projected/627b6734-fb25-48c2-89ff-0a8a9d595143-kube-api-access-p5mh4\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:43.836145 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.836118 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" Jun 03 23:08:43.968566 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:43.968512 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz"] Jun 03 23:08:43.970741 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:08:43.970702 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30b10fb_f935_4655_aa80_8a39866efd7e.slice/crio-9d29d57895fe2aa0018657819b41081199a2620761217927f1c554a4e1292429 WatchSource:0}: Error finding container 9d29d57895fe2aa0018657819b41081199a2620761217927f1c554a4e1292429: Status 404 returned error can't find the container with id 9d29d57895fe2aa0018657819b41081199a2620761217927f1c554a4e1292429 Jun 03 23:08:44.310702 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.310663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/627b6734-fb25-48c2-89ff-0a8a9d595143-cert\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:44.313079 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.313055 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/627b6734-fb25-48c2-89ff-0a8a9d595143-cert\") pod \"odh-model-controller-6dc94f689f-585fh\" (UID: \"627b6734-fb25-48c2-89ff-0a8a9d595143\") " pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:44.428583 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.428546 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" event={"ID":"e30b10fb-f935-4655-aa80-8a39866efd7e","Type":"ContainerStarted","Data":"9d29d57895fe2aa0018657819b41081199a2620761217927f1c554a4e1292429"} Jun 03 23:08:44.529492 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.529317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:44.533248 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.533211 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9qzw6"] Jun 03 23:08:44.536854 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.536832 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.539169 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.539145 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wlrws\"" Jun 03 23:08:44.539542 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.539525 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 23:08:44.549242 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.549212 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9qzw6"] Jun 03 23:08:44.613725 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.613689 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjhx\" (UniqueName: \"kubernetes.io/projected/6de330dc-23d2-435b-bdb0-9b9cc2234f63-kube-api-access-9kjhx\") pod \"model-serving-api-5dd488fc48-9qzw6\" (UID: \"6de330dc-23d2-435b-bdb0-9b9cc2234f63\") " pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.613866 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.613825 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de330dc-23d2-435b-bdb0-9b9cc2234f63-tls-certs\") pod \"model-serving-api-5dd488fc48-9qzw6\" (UID: \"6de330dc-23d2-435b-bdb0-9b9cc2234f63\") " pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.692798 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.692765 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-585fh"] Jun 03 23:08:44.695010 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:08:44.694974 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627b6734_fb25_48c2_89ff_0a8a9d595143.slice/crio-ae07ee21818437516eee7ef749e39736b217ba5ada106c1a7077a2812f40db11 WatchSource:0}: Error finding container ae07ee21818437516eee7ef749e39736b217ba5ada106c1a7077a2812f40db11: Status 404 returned error can't find the container with id ae07ee21818437516eee7ef749e39736b217ba5ada106c1a7077a2812f40db11 Jun 03 23:08:44.714999 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.714965 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de330dc-23d2-435b-bdb0-9b9cc2234f63-tls-certs\") pod \"model-serving-api-5dd488fc48-9qzw6\" (UID: \"6de330dc-23d2-435b-bdb0-9b9cc2234f63\") " pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.715137 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.715057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjhx\" (UniqueName: \"kubernetes.io/projected/6de330dc-23d2-435b-bdb0-9b9cc2234f63-kube-api-access-9kjhx\") pod \"model-serving-api-5dd488fc48-9qzw6\" (UID: \"6de330dc-23d2-435b-bdb0-9b9cc2234f63\") " pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.719163 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.719095 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de330dc-23d2-435b-bdb0-9b9cc2234f63-tls-certs\") pod \"model-serving-api-5dd488fc48-9qzw6\" (UID: \"6de330dc-23d2-435b-bdb0-9b9cc2234f63\") " pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.724088 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.724060 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjhx\" (UniqueName: \"kubernetes.io/projected/6de330dc-23d2-435b-bdb0-9b9cc2234f63-kube-api-access-9kjhx\") pod \"model-serving-api-5dd488fc48-9qzw6\" (UID: \"6de330dc-23d2-435b-bdb0-9b9cc2234f63\") " pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:44.851261 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:44.851090 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:45.016933 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:45.016897 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9qzw6"] Jun 03 23:08:45.021237 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:08:45.021203 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de330dc_23d2_435b_bdb0_9b9cc2234f63.slice/crio-0f06e662dc9aa31db2c30f3c17701b6f68fe48eb60e962ebe10a99d672f99f85 WatchSource:0}: Error finding container 0f06e662dc9aa31db2c30f3c17701b6f68fe48eb60e962ebe10a99d672f99f85: Status 404 returned error can't find the container with id 0f06e662dc9aa31db2c30f3c17701b6f68fe48eb60e962ebe10a99d672f99f85 Jun 03 23:08:45.435196 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:45.435165 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" event={"ID":"6de330dc-23d2-435b-bdb0-9b9cc2234f63","Type":"ContainerStarted","Data":"0f06e662dc9aa31db2c30f3c17701b6f68fe48eb60e962ebe10a99d672f99f85"} Jun 03 23:08:45.436499 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:45.436470 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" event={"ID":"627b6734-fb25-48c2-89ff-0a8a9d595143","Type":"ContainerStarted","Data":"ae07ee21818437516eee7ef749e39736b217ba5ada106c1a7077a2812f40db11"} Jun 03 23:08:49.456382 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.456343 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" event={"ID":"627b6734-fb25-48c2-89ff-0a8a9d595143","Type":"ContainerStarted","Data":"fa9c530ce8f7203e1dd292dea50fc1943b02ef68a920d1a42356320fcaa1b7cd"} Jun 03 23:08:49.456883 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.456471 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:08:49.458062 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.458031 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" event={"ID":"e30b10fb-f935-4655-aa80-8a39866efd7e","Type":"ContainerStarted","Data":"76a20ffd7d2c84ae84ca78a3ebff984c8cd16b356382c2e2e609eb9b86db1a56"} Jun 03 23:08:49.459336 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.459312 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" event={"ID":"6de330dc-23d2-435b-bdb0-9b9cc2234f63","Type":"ContainerStarted","Data":"30f52a21b7a1c0a6ce6b60757f4c4cd747e2ac5255e73313c4cca5f13e266169"} Jun 03 23:08:49.459464 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.459448 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:08:49.478613 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.478566 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" podStartSLOduration=2.5780176150000003 podStartE2EDuration="6.478551965s" totalImagesPullingTime="3.90053435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:49.47701117 +0000 UTC m=+374.115103930" watchObservedRunningTime="2026-06-03 23:08:49.478551965 +0000 UTC m=+374.116644703" Jun 03 23:08:49.495113 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.495058 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cd4f89b79-754jz" podStartSLOduration=2.238592465 podStartE2EDuration="6.495043971s" totalImagesPullingTime="4.256451506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:49.494234578 +0000 UTC m=+374.132327328" watchObservedRunningTime="2026-06-03 23:08:49.495043971 +0000 UTC m=+374.133136719" Jun 03 23:08:49.512101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:49.512043 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" podStartSLOduration=1.901377565 podStartE2EDuration="5.512021356s" totalImagesPullingTime="3.610643791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:49.510095007 +0000 UTC m=+374.148187758" watchObservedRunningTime="2026-06-03 23:08:49.512021356 +0000 UTC m=+374.150114104" Jun 03 23:08:54.499959 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.499926 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dlzxc"] Jun 03 23:08:54.502996 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.502979 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.505731 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.505708 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 23:08:54.505873 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.505855 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dq2zg\"" Jun 03 23:08:54.508209 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.508188 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz"] Jun 03 23:08:54.516901 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.516863 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:54.518283 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.518263 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dlzxc"] Jun 03 23:08:54.521260 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.521243 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fn2zd\"" Jun 03 23:08:54.521736 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.521715 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 23:08:54.525988 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.525966 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz"] Jun 03 23:08:54.598896 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.598852 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee44e9f9-a392-4ecf-9712-adea7ba90053-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:54.598896 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.598902 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxc4\" (UniqueName: \"kubernetes.io/projected/ee44e9f9-a392-4ecf-9712-adea7ba90053-kube-api-access-qfxc4\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:54.599117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.598920 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e8e55a-ff35-439b-aba1-02deb425c514-cert\") pod \"kserve-controller-manager-69fc866d76-dlzxc\" (UID: \"a0e8e55a-ff35-439b-aba1-02deb425c514\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.599117 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.598965 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtl4v\" (UniqueName: \"kubernetes.io/projected/a0e8e55a-ff35-439b-aba1-02deb425c514-kube-api-access-rtl4v\") pod \"kserve-controller-manager-69fc866d76-dlzxc\" (UID: \"a0e8e55a-ff35-439b-aba1-02deb425c514\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.699482 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.699437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxc4\" (UniqueName: \"kubernetes.io/projected/ee44e9f9-a392-4ecf-9712-adea7ba90053-kube-api-access-qfxc4\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:54.699482 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.699479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e8e55a-ff35-439b-aba1-02deb425c514-cert\") pod \"kserve-controller-manager-69fc866d76-dlzxc\" (UID: \"a0e8e55a-ff35-439b-aba1-02deb425c514\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.699739 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.699496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtl4v\" (UniqueName: \"kubernetes.io/projected/a0e8e55a-ff35-439b-aba1-02deb425c514-kube-api-access-rtl4v\") pod \"kserve-controller-manager-69fc866d76-dlzxc\" (UID: \"a0e8e55a-ff35-439b-aba1-02deb425c514\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.699739 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.699558 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee44e9f9-a392-4ecf-9712-adea7ba90053-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:54.699739 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:08:54.699692 2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 03 23:08:54.699856 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:08:54.699774 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee44e9f9-a392-4ecf-9712-adea7ba90053-cert podName:ee44e9f9-a392-4ecf-9712-adea7ba90053 nodeName:}" failed. No retries permitted until 2026-06-03 23:08:55.199753601 +0000 UTC m=+379.837846341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee44e9f9-a392-4ecf-9712-adea7ba90053-cert") pod "llmisvc-controller-manager-864bfd7bc9-rfrhz" (UID: "ee44e9f9-a392-4ecf-9712-adea7ba90053") : secret "llmisvc-webhook-server-cert" not found Jun 03 23:08:54.702099 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.702074 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e8e55a-ff35-439b-aba1-02deb425c514-cert\") pod \"kserve-controller-manager-69fc866d76-dlzxc\" (UID: \"a0e8e55a-ff35-439b-aba1-02deb425c514\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.711974 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.711944 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtl4v\" (UniqueName: \"kubernetes.io/projected/a0e8e55a-ff35-439b-aba1-02deb425c514-kube-api-access-rtl4v\") pod \"kserve-controller-manager-69fc866d76-dlzxc\" (UID: \"a0e8e55a-ff35-439b-aba1-02deb425c514\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.712176 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.712157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxc4\" (UniqueName: \"kubernetes.io/projected/ee44e9f9-a392-4ecf-9712-adea7ba90053-kube-api-access-qfxc4\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:54.819865 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.819780 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:54.966775 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:54.966747 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dlzxc"] Jun 03 23:08:54.969239 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:08:54.969214 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e8e55a_ff35_439b_aba1_02deb425c514.slice/crio-00f2a5ea5835a871232afb7fa2da242fae046e078a2cba3cdd254b90cef09e5b WatchSource:0}: Error finding container 00f2a5ea5835a871232afb7fa2da242fae046e078a2cba3cdd254b90cef09e5b: Status 404 returned error can't find the container with id 00f2a5ea5835a871232afb7fa2da242fae046e078a2cba3cdd254b90cef09e5b Jun 03 23:08:55.205388 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:55.205347 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee44e9f9-a392-4ecf-9712-adea7ba90053-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:55.207789 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:55.207759 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee44e9f9-a392-4ecf-9712-adea7ba90053-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rfrhz\" (UID: \"ee44e9f9-a392-4ecf-9712-adea7ba90053\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:55.429198 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:55.429157 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:55.488957 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:55.488911 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" event={"ID":"a0e8e55a-ff35-439b-aba1-02deb425c514","Type":"ContainerStarted","Data":"00f2a5ea5835a871232afb7fa2da242fae046e078a2cba3cdd254b90cef09e5b"} Jun 03 23:08:55.567584 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:55.567552 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz"] Jun 03 23:08:55.571281 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:08:55.571250 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee44e9f9_a392_4ecf_9712_adea7ba90053.slice/crio-beadba4bb216ee9bd61592509898fe58bb5f90be1c9115b17ac12e342097daf3 WatchSource:0}: Error finding container beadba4bb216ee9bd61592509898fe58bb5f90be1c9115b17ac12e342097daf3: Status 404 returned error can't find the container with id beadba4bb216ee9bd61592509898fe58bb5f90be1c9115b17ac12e342097daf3 Jun 03 23:08:56.494359 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:56.494326 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" event={"ID":"ee44e9f9-a392-4ecf-9712-adea7ba90053","Type":"ContainerStarted","Data":"beadba4bb216ee9bd61592509898fe58bb5f90be1c9115b17ac12e342097daf3"} Jun 03 23:08:58.507675 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:58.507561 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" event={"ID":"a0e8e55a-ff35-439b-aba1-02deb425c514","Type":"ContainerStarted","Data":"83d2edb4c639f8d3e17a22c1d1c41437099bfe077954a3786a3fed0e74bc3d5a"} Jun 03 23:08:58.508216 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:58.507838 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:08:59.518060 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:59.518016 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" event={"ID":"ee44e9f9-a392-4ecf-9712-adea7ba90053","Type":"ContainerStarted","Data":"4dac95e2db3788009de38176e82a417b1c9d9642630205812c9d38ca22f27610"} Jun 03 23:08:59.518540 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:59.518247 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:08:59.608708 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:59.608635 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" podStartSLOduration=2.56028701 podStartE2EDuration="5.608613229s" totalImagesPullingTime="3.048326219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:59.604780313 +0000 UTC m=+384.242873061" watchObservedRunningTime="2026-06-03 23:08:59.608613229 +0000 UTC m=+384.246705976" Jun 03 23:08:59.608984 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:08:59.608959 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" podStartSLOduration=2.876448338 podStartE2EDuration="5.608951511s" totalImagesPullingTime="2.732503173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:58.585209383 +0000 UTC m=+383.223302131" watchObservedRunningTime="2026-06-03 23:08:59.608951511 +0000 UTC m=+384.247044256" Jun 03 23:09:00.464964 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:00.464925 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-585fh" Jun 03 23:09:00.466871 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:00.466851 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-9qzw6" Jun 03 23:09:01.219431 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.219393 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq"] Jun 03 23:09:01.222953 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.222931 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.225632 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.225612 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 23:09:01.226214 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.226199 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 23:09:01.226479 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.226465 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-gjgbj\"" Jun 03 23:09:01.360323 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.360288 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/68018154-f2fe-4064-a840-051a513bbae6-operator-config\") pod \"servicemesh-operator3-57f65f65fb-zz9tq\" (UID: \"68018154-f2fe-4064-a840-051a513bbae6\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.360497 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.360354 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj84c\" (UniqueName: \"kubernetes.io/projected/68018154-f2fe-4064-a840-051a513bbae6-kube-api-access-hj84c\") pod \"servicemesh-operator3-57f65f65fb-zz9tq\" (UID: \"68018154-f2fe-4064-a840-051a513bbae6\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.372778 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.372740 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq"] Jun 03 23:09:01.461793 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.461755 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/68018154-f2fe-4064-a840-051a513bbae6-operator-config\") pod \"servicemesh-operator3-57f65f65fb-zz9tq\" (UID: \"68018154-f2fe-4064-a840-051a513bbae6\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.461979 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.461852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj84c\" (UniqueName: \"kubernetes.io/projected/68018154-f2fe-4064-a840-051a513bbae6-kube-api-access-hj84c\") pod \"servicemesh-operator3-57f65f65fb-zz9tq\" (UID: \"68018154-f2fe-4064-a840-051a513bbae6\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.464399 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.464364 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/68018154-f2fe-4064-a840-051a513bbae6-operator-config\") pod \"servicemesh-operator3-57f65f65fb-zz9tq\" (UID: \"68018154-f2fe-4064-a840-051a513bbae6\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.472444 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.472384 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj84c\" (UniqueName: \"kubernetes.io/projected/68018154-f2fe-4064-a840-051a513bbae6-kube-api-access-hj84c\") pod \"servicemesh-operator3-57f65f65fb-zz9tq\" (UID: \"68018154-f2fe-4064-a840-051a513bbae6\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.532073 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.532043 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:01.683447 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:01.683421 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq"] Jun 03 23:09:01.685885 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:09:01.685851 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68018154_f2fe_4064_a840_051a513bbae6.slice/crio-ae47deb7d5d7588e7977acfdb5df5914c270772f4ab2a524845ef206705f732b WatchSource:0}: Error finding container ae47deb7d5d7588e7977acfdb5df5914c270772f4ab2a524845ef206705f732b: Status 404 returned error can't find the container with id ae47deb7d5d7588e7977acfdb5df5914c270772f4ab2a524845ef206705f732b Jun 03 23:09:02.531082 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:02.531048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" event={"ID":"68018154-f2fe-4064-a840-051a513bbae6","Type":"ContainerStarted","Data":"ae47deb7d5d7588e7977acfdb5df5914c270772f4ab2a524845ef206705f732b"} Jun 03 23:09:10.569913 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:10.569876 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" event={"ID":"68018154-f2fe-4064-a840-051a513bbae6","Type":"ContainerStarted","Data":"67800454b1c80583e32723730a9232398c69608b6ba1035389046f4fd903f678"} Jun 03 23:09:10.570355 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:10.569988 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:10.590900 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:10.590833 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" podStartSLOduration=0.812841275 podStartE2EDuration="9.590816459s" totalImagesPullingTime="8.777975184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:10.588880711 +0000 UTC m=+395.226973460" watchObservedRunningTime="2026-06-03 23:09:10.590816459 +0000 UTC m=+395.228909206" Jun 03 23:09:13.934915 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.934880 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-574764c5bd-tqhsk"] Jun 03 23:09:13.938175 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.938159 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:13.941804 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.941781 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bztwh\"" Jun 03 23:09:13.942016 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.941976 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 23:09:13.954319 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.954294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f60e8d68-324e-4024-9e79-d7f366df304e-redirect-config\") pod \"dashboard-redirect-574764c5bd-tqhsk\" (UID: \"f60e8d68-324e-4024-9e79-d7f366df304e\") " pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:13.954447 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.954334 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2lm\" (UniqueName: \"kubernetes.io/projected/f60e8d68-324e-4024-9e79-d7f366df304e-kube-api-access-bd2lm\") pod \"dashboard-redirect-574764c5bd-tqhsk\" (UID: \"f60e8d68-324e-4024-9e79-d7f366df304e\") " pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:13.960160 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.960138 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8"] Jun 03 23:09:13.963676 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.963640 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-574764c5bd-tqhsk"] Jun 03 23:09:13.964101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.963768 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:13.966606 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.966577 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 23:09:13.966724 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.966696 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 23:09:13.966861 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.966716 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 23:09:13.966861 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.966722 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cwtqr\"" Jun 03 23:09:13.967035 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.967013 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 23:09:13.988839 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:13.988812 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8"] Jun 03 23:09:14.055597 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2lm\" (UniqueName: \"kubernetes.io/projected/f60e8d68-324e-4024-9e79-d7f366df304e-kube-api-access-bd2lm\") pod \"dashboard-redirect-574764c5bd-tqhsk\" (UID: \"f60e8d68-324e-4024-9e79-d7f366df304e\") " pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:14.055782 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.055782 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055671 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.055782 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.055782 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.055966 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.055966 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055873 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f60e8d68-324e-4024-9e79-d7f366df304e-redirect-config\") pod \"dashboard-redirect-574764c5bd-tqhsk\" (UID: \"f60e8d68-324e-4024-9e79-d7f366df304e\") " pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:14.055966 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea8935e-0e2a-4ce7-be44-5beaea143e05-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.055966 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.055932 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7jsd\" (UniqueName: \"kubernetes.io/projected/4ea8935e-0e2a-4ce7-be44-5beaea143e05-kube-api-access-r7jsd\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.056532 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.056512 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f60e8d68-324e-4024-9e79-d7f366df304e-redirect-config\") pod \"dashboard-redirect-574764c5bd-tqhsk\" (UID: \"f60e8d68-324e-4024-9e79-d7f366df304e\") " pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:14.064780 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.064754 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2lm\" (UniqueName: \"kubernetes.io/projected/f60e8d68-324e-4024-9e79-d7f366df304e-kube-api-access-bd2lm\") pod \"dashboard-redirect-574764c5bd-tqhsk\" (UID: \"f60e8d68-324e-4024-9e79-d7f366df304e\") " pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:14.156593 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156553 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.156593 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156599 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea8935e-0e2a-4ce7-be44-5beaea143e05-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.156853 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7jsd\" (UniqueName: \"kubernetes.io/projected/4ea8935e-0e2a-4ce7-be44-5beaea143e05-kube-api-access-r7jsd\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.156853 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156666 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.156853 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156701 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.156853 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156719 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.156853 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.156738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.157626 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.157592 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.159036 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.159008 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea8935e-0e2a-4ce7-be44-5beaea143e05-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.159352 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.159325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.159420 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.159396 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.159617 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.159597 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4ea8935e-0e2a-4ce7-be44-5beaea143e05-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.165494 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.165437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea8935e-0e2a-4ce7-be44-5beaea143e05-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.165578 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.165532 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7jsd\" (UniqueName: \"kubernetes.io/projected/4ea8935e-0e2a-4ce7-be44-5beaea143e05-kube-api-access-r7jsd\") pod \"istiod-openshift-gateway-75c67f8887-8rfb8\" (UID: \"4ea8935e-0e2a-4ce7-be44-5beaea143e05\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.249018 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.248985 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" Jun 03 23:09:14.274349 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.274315 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:14.401308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.401276 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-574764c5bd-tqhsk"] Jun 03 23:09:14.404984 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:09:14.404951 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60e8d68_324e_4024_9e79_d7f366df304e.slice/crio-f93ba58cf60a3d4d396eaaef95341eab2cee17a2f5098750cce367901fecaef0 WatchSource:0}: Error finding container f93ba58cf60a3d4d396eaaef95341eab2cee17a2f5098750cce367901fecaef0: Status 404 returned error can't find the container with id f93ba58cf60a3d4d396eaaef95341eab2cee17a2f5098750cce367901fecaef0 Jun 03 23:09:14.427897 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.427873 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8"] Jun 03 23:09:14.430130 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:09:14.430101 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea8935e_0e2a_4ce7_be44_5beaea143e05.slice/crio-ba847ecee3a01f4e9cdadb675a9f4ee7e870bf97cf1f3302bd6fa51d3cd368b9 WatchSource:0}: Error finding container ba847ecee3a01f4e9cdadb675a9f4ee7e870bf97cf1f3302bd6fa51d3cd368b9: Status 404 returned error can't find the container with id ba847ecee3a01f4e9cdadb675a9f4ee7e870bf97cf1f3302bd6fa51d3cd368b9 Jun 03 23:09:14.591982 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.591941 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" event={"ID":"4ea8935e-0e2a-4ce7-be44-5beaea143e05","Type":"ContainerStarted","Data":"ba847ecee3a01f4e9cdadb675a9f4ee7e870bf97cf1f3302bd6fa51d3cd368b9"} Jun 03 23:09:14.593104 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:14.593065 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" event={"ID":"f60e8d68-324e-4024-9e79-d7f366df304e","Type":"ContainerStarted","Data":"f93ba58cf60a3d4d396eaaef95341eab2cee17a2f5098750cce367901fecaef0"} Jun 03 23:09:19.605763 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:19.605693 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:09:19.606154 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:19.605783 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:09:20.637961 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.637919 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" event={"ID":"f60e8d68-324e-4024-9e79-d7f366df304e","Type":"ContainerStarted","Data":"88f7e0ff821326a5c5b0bdda0692b7f10b9bdec9a3687d08945f95ab27e6e3c1"} Jun 03 23:09:20.639664 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.639623 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" event={"ID":"4ea8935e-0e2a-4ce7-be44-5beaea143e05","Type":"ContainerStarted","Data":"b48f86481451d017730129c1482553a483a7ba75204ba54eef0c05d707fd9b69"} Jun 03 23:09:20.639777 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.639706 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:20.641308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.641284 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-8rfb8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 23:09:20.641367 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.641330 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" podUID="4ea8935e-0e2a-4ce7-be44-5beaea143e05" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:09:20.657796 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.657745 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-574764c5bd-tqhsk" podStartSLOduration=2.393075538 podStartE2EDuration="7.657731244s" totalImagesPullingTime="5.264655706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:20.656423804 +0000 UTC m=+405.294516551" watchObservedRunningTime="2026-06-03 23:09:20.657731244 +0000 UTC m=+405.295823992" Jun 03 23:09:20.679063 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:20.679004 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" podStartSLOduration=2.508709602 podStartE2EDuration="7.678981775s" totalImagesPullingTime="5.170272173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:20.676594376 +0000 UTC m=+405.314687124" watchObservedRunningTime="2026-06-03 23:09:20.678981775 +0000 UTC m=+405.317074523" Jun 03 23:09:21.586147 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:21.586114 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zz9tq" Jun 03 23:09:21.645041 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:21.645010 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8rfb8" Jun 03 23:09:29.523806 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:29.523773 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dlzxc" Jun 03 23:09:30.524391 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:09:30.524363 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rfrhz" Jun 03 23:10:24.074765 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.074728 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4"] Jun 03 23:10:24.078137 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.078112 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.083551 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.083525 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:10:24.083551 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.083541 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8fp6\"" Jun 03 23:10:24.085270 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.084694 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:10:24.100606 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.100580 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4"] Jun 03 23:10:24.146626 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.146590 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wst\" (UniqueName: \"kubernetes.io/projected/1311af95-0130-4e21-8b8d-8874b2956454-kube-api-access-f7wst\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.146811 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.146636 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1311af95-0130-4e21-8b8d-8874b2956454-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.248116 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.248079 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wst\" (UniqueName: \"kubernetes.io/projected/1311af95-0130-4e21-8b8d-8874b2956454-kube-api-access-f7wst\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.248307 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.248129 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1311af95-0130-4e21-8b8d-8874b2956454-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.248503 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.248487 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1311af95-0130-4e21-8b8d-8874b2956454-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.262695 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.262670 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wst\" (UniqueName: \"kubernetes.io/projected/1311af95-0130-4e21-8b8d-8874b2956454-kube-api-access-f7wst\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.388337 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.388233 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:24.531115 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.531082 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4"] Jun 03 23:10:24.534540 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:10:24.534512 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1311af95_0130_4e21_8b8d_8874b2956454.slice/crio-8cddbbc856b8458cafc43544928dad54f23b439038094e91c771dda66f55a8b9 WatchSource:0}: Error finding container 8cddbbc856b8458cafc43544928dad54f23b439038094e91c771dda66f55a8b9: Status 404 returned error can't find the container with id 8cddbbc856b8458cafc43544928dad54f23b439038094e91c771dda66f55a8b9 Jun 03 23:10:24.930429 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:24.930385 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" event={"ID":"1311af95-0130-4e21-8b8d-8874b2956454","Type":"ContainerStarted","Data":"8cddbbc856b8458cafc43544928dad54f23b439038094e91c771dda66f55a8b9"} Jun 03 23:10:29.958503 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:29.958419 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" event={"ID":"1311af95-0130-4e21-8b8d-8874b2956454","Type":"ContainerStarted","Data":"3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7"} Jun 03 23:10:29.958968 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:29.958600 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:29.991635 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:29.991527 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" podStartSLOduration=0.796761888 podStartE2EDuration="5.991508762s" totalImagesPullingTime="5.194746874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:10:29.989804247 +0000 UTC m=+474.627896997" watchObservedRunningTime="2026-06-03 23:10:29.991508762 +0000 UTC m=+474.629601512" Jun 03 23:10:40.964902 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:40.964870 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:42.627083 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.627049 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4"] Jun 03 23:10:42.627488 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.627227 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" podUID="1311af95-0130-4e21-8b8d-8874b2956454" containerName="manager" containerID="cri-o://3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7" gracePeriod=2 Jun 03 23:10:42.637704 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.637675 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4"] Jun 03 23:10:42.638784 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:10:42.638745 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1311af95-0130-4e21-8b8d-8874b2956454\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:42.694849 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.694817 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc"] Jun 03 23:10:42.695180 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.695167 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1311af95-0130-4e21-8b8d-8874b2956454" containerName="manager" Jun 03 23:10:42.695226 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.695182 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1311af95-0130-4e21-8b8d-8874b2956454" containerName="manager" Jun 03 23:10:42.695260 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.695241 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1311af95-0130-4e21-8b8d-8874b2956454" containerName="manager" Jun 03 23:10:42.698338 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.698312 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:10:42.702777 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.702748 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9hxgc\"" Jun 03 23:10:42.710213 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.710188 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc"] Jun 03 23:10:42.727060 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:10:42.727015 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" is forbidden: User \"system:node:ip-10-0-138-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-203.ec2.internal' and this object" podUID="1311af95-0130-4e21-8b8d-8874b2956454" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:42.809399 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.809361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv78z\" (UniqueName: \"kubernetes.io/projected/eb606f6b-62b9-49f6-afb4-7f208bee4c4c-kube-api-access-sv78z\") pod \"limitador-operator-controller-manager-859d7b78bd-cs2cc\" (UID: \"eb606f6b-62b9-49f6-afb4-7f208bee4c4c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:10:42.872308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.872283 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:42.874503 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:10:42.874480 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" is forbidden: User \"system:node:ip-10-0-138-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-203.ec2.internal' and this object" podUID="1311af95-0130-4e21-8b8d-8874b2956454" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:42.910911 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.910810 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv78z\" (UniqueName: \"kubernetes.io/projected/eb606f6b-62b9-49f6-afb4-7f208bee4c4c-kube-api-access-sv78z\") pod \"limitador-operator-controller-manager-859d7b78bd-cs2cc\" (UID: \"eb606f6b-62b9-49f6-afb4-7f208bee4c4c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:10:42.930824 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:42.930798 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv78z\" (UniqueName: \"kubernetes.io/projected/eb606f6b-62b9-49f6-afb4-7f208bee4c4c-kube-api-access-sv78z\") pod \"limitador-operator-controller-manager-859d7b78bd-cs2cc\" (UID: \"eb606f6b-62b9-49f6-afb4-7f208bee4c4c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:10:43.011505 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.011469 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1311af95-0130-4e21-8b8d-8874b2956454-extensions-socket-volume\") pod \"1311af95-0130-4e21-8b8d-8874b2956454\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " Jun 03 23:10:43.011707 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.011529 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7wst\" (UniqueName: \"kubernetes.io/projected/1311af95-0130-4e21-8b8d-8874b2956454-kube-api-access-f7wst\") pod \"1311af95-0130-4e21-8b8d-8874b2956454\" (UID: \"1311af95-0130-4e21-8b8d-8874b2956454\") " Jun 03 23:10:43.011886 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.011859 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1311af95-0130-4e21-8b8d-8874b2956454-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1311af95-0130-4e21-8b8d-8874b2956454" (UID: "1311af95-0130-4e21-8b8d-8874b2956454"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:43.013393 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.013368 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:10:43.014009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.013981 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1311af95-0130-4e21-8b8d-8874b2956454-kube-api-access-f7wst" (OuterVolumeSpecName: "kube-api-access-f7wst") pod "1311af95-0130-4e21-8b8d-8874b2956454" (UID: "1311af95-0130-4e21-8b8d-8874b2956454"). InnerVolumeSpecName "kube-api-access-f7wst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:10:43.017876 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.017853 2552 generic.go:356] "Generic (PLEG): container finished" podID="1311af95-0130-4e21-8b8d-8874b2956454" containerID="3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7" exitCode=0 Jun 03 23:10:43.017974 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.017898 2552 scope.go:117] "RemoveContainer" containerID="3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7" Jun 03 23:10:43.017974 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.017914 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:43.022497 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:10:43.022452 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" is forbidden: User \"system:node:ip-10-0-138-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-203.ec2.internal' and this object" podUID="1311af95-0130-4e21-8b8d-8874b2956454" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:43.029159 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.029137 2552 scope.go:117] "RemoveContainer" containerID="3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7" Jun 03 23:10:43.029814 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:10:43.029785 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7\": container with ID starting with 3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7 not found: ID does not exist" containerID="3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7" Jun 03 23:10:43.029920 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.029823 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7"} err="failed to get container status \"3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7\": rpc error: code = NotFound desc = could not find container \"3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7\": container with ID starting with 3fb53e0581a948f69c801d8194b022b7b102dc79c1c41e61646a111fd47bb6f7 not found: ID does not exist" Jun 03 23:10:43.032699 ip-10-0-138-203 kubenswrapper[2552]: E0603 23:10:43.032667 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2cnd4\" is forbidden: User \"system:node:ip-10-0-138-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-203.ec2.internal' and this object" podUID="1311af95-0130-4e21-8b8d-8874b2956454" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2cnd4" Jun 03 23:10:43.112222 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.112190 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1311af95-0130-4e21-8b8d-8874b2956454-extensions-socket-volume\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:10:43.112222 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.112222 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7wst\" (UniqueName: \"kubernetes.io/projected/1311af95-0130-4e21-8b8d-8874b2956454-kube-api-access-f7wst\") on node \"ip-10-0-138-203.ec2.internal\" DevicePath \"\"" Jun 03 23:10:43.166174 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.166151 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc"] Jun 03 23:10:43.168232 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:10:43.168207 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb606f6b_62b9_49f6_afb4_7f208bee4c4c.slice/crio-1df09c333db05a1d73910ad6a668b0c9ae47ebcfea73a0ce4e5b7d4c868dc5f6 WatchSource:0}: Error finding container 1df09c333db05a1d73910ad6a668b0c9ae47ebcfea73a0ce4e5b7d4c868dc5f6: Status 404 returned error can't find the container with id 1df09c333db05a1d73910ad6a668b0c9ae47ebcfea73a0ce4e5b7d4c868dc5f6 Jun 03 23:10:43.821642 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:43.821589 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1311af95-0130-4e21-8b8d-8874b2956454" path="/var/lib/kubelet/pods/1311af95-0130-4e21-8b8d-8874b2956454/volumes" Jun 03 23:10:44.029722 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:44.029567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" event={"ID":"eb606f6b-62b9-49f6-afb4-7f208bee4c4c","Type":"ContainerStarted","Data":"1df09c333db05a1d73910ad6a668b0c9ae47ebcfea73a0ce4e5b7d4c868dc5f6"} Jun 03 23:10:45.038017 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:45.037983 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" event={"ID":"eb606f6b-62b9-49f6-afb4-7f208bee4c4c","Type":"ContainerStarted","Data":"53d8855f5d43091094e7e3427f53e0bdfca1cf76360ec48d389675bb8e96e830"} Jun 03 23:10:45.038490 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:45.038092 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:10:45.084612 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:45.084559 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" podStartSLOduration=1.847192789 podStartE2EDuration="3.084543882s" totalImagesPullingTime="1.237351093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:10:45.083458003 +0000 UTC m=+489.721550751" watchObservedRunningTime="2026-06-03 23:10:45.084543882 +0000 UTC m=+489.722636623" Jun 03 23:10:56.045708 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:10:56.045673 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2cc" Jun 03 23:11:20.805828 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.805777 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:11:20.809589 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.809565 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:20.811865 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.811840 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m4mqh\"" Jun 03 23:11:20.811969 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.811890 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 23:11:20.818819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.818797 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:11:20.844756 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.844717 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:11:20.851211 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.851179 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/863f56f5-aaa8-45d7-8a4e-9e494072447e-config-file\") pod \"limitador-limitador-54d6d988d5-d6x59\" (UID: \"863f56f5-aaa8-45d7-8a4e-9e494072447e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:20.851358 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.851231 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsgn\" (UniqueName: \"kubernetes.io/projected/863f56f5-aaa8-45d7-8a4e-9e494072447e-kube-api-access-zfsgn\") pod \"limitador-limitador-54d6d988d5-d6x59\" (UID: \"863f56f5-aaa8-45d7-8a4e-9e494072447e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:20.952311 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.952274 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/863f56f5-aaa8-45d7-8a4e-9e494072447e-config-file\") pod \"limitador-limitador-54d6d988d5-d6x59\" (UID: \"863f56f5-aaa8-45d7-8a4e-9e494072447e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:20.952524 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.952318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsgn\" (UniqueName: \"kubernetes.io/projected/863f56f5-aaa8-45d7-8a4e-9e494072447e-kube-api-access-zfsgn\") pod \"limitador-limitador-54d6d988d5-d6x59\" (UID: \"863f56f5-aaa8-45d7-8a4e-9e494072447e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:20.953029 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.953002 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/863f56f5-aaa8-45d7-8a4e-9e494072447e-config-file\") pod \"limitador-limitador-54d6d988d5-d6x59\" (UID: \"863f56f5-aaa8-45d7-8a4e-9e494072447e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:20.970610 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:20.970583 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsgn\" (UniqueName: \"kubernetes.io/projected/863f56f5-aaa8-45d7-8a4e-9e494072447e-kube-api-access-zfsgn\") pod \"limitador-limitador-54d6d988d5-d6x59\" (UID: \"863f56f5-aaa8-45d7-8a4e-9e494072447e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:21.119944 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:21.119906 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:21.266820 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:21.266768 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:11:21.269847 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:11:21.269823 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863f56f5_aaa8_45d7_8a4e_9e494072447e.slice/crio-1983fff3ae98d22a3e68b4121970b41dcfd3ecbce8848b0e9c22fbce61fa50fa WatchSource:0}: Error finding container 1983fff3ae98d22a3e68b4121970b41dcfd3ecbce8848b0e9c22fbce61fa50fa: Status 404 returned error can't find the container with id 1983fff3ae98d22a3e68b4121970b41dcfd3ecbce8848b0e9c22fbce61fa50fa Jun 03 23:11:22.220809 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:22.220768 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" event={"ID":"863f56f5-aaa8-45d7-8a4e-9e494072447e","Type":"ContainerStarted","Data":"1983fff3ae98d22a3e68b4121970b41dcfd3ecbce8848b0e9c22fbce61fa50fa"} Jun 03 23:11:24.232276 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:24.232234 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" event={"ID":"863f56f5-aaa8-45d7-8a4e-9e494072447e","Type":"ContainerStarted","Data":"a1b4e6eef7022401ce6976809d8153908198bc9424ec408eed34a2cc17d6a2e8"} Jun 03 23:11:24.232693 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:24.232353 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:11:24.251197 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:24.251143 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" podStartSLOduration=1.785281639 podStartE2EDuration="4.251123231s" totalImagesPullingTime="2.465841592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:11:24.250165008 +0000 UTC m=+528.888257781" watchObservedRunningTime="2026-06-03 23:11:24.251123231 +0000 UTC m=+528.889215979" Jun 03 23:11:35.237692 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:11:35.237633 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d6x59" Jun 03 23:12:35.790472 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:12:35.790442 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:12:35.791280 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:12:35.791261 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:13:25.705892 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.705857 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gqzd9"] Jun 03 23:13:25.708751 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.708730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:13:25.713007 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.712986 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 23:13:25.788401 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.788365 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gqzd9"] Jun 03 23:13:25.829604 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.829573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmpm\" (UniqueName: \"kubernetes.io/projected/1d3e1c01-18f0-46ca-920e-8aeb3d91d380-kube-api-access-ghmpm\") pod \"payload-pre-processing-67d7689b65-gqzd9\" (UID: \"1d3e1c01-18f0-46ca-920e-8aeb3d91d380\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:13:25.930045 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.930002 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmpm\" (UniqueName: \"kubernetes.io/projected/1d3e1c01-18f0-46ca-920e-8aeb3d91d380-kube-api-access-ghmpm\") pod \"payload-pre-processing-67d7689b65-gqzd9\" (UID: \"1d3e1c01-18f0-46ca-920e-8aeb3d91d380\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:13:25.942749 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.942716 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmpm\" (UniqueName: \"kubernetes.io/projected/1d3e1c01-18f0-46ca-920e-8aeb3d91d380-kube-api-access-ghmpm\") pod \"payload-pre-processing-67d7689b65-gqzd9\" (UID: \"1d3e1c01-18f0-46ca-920e-8aeb3d91d380\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:13:25.970553 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:25.970462 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:13:26.018713 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:26.018679 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:13:26.158516 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:26.158468 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gqzd9"] Jun 03 23:13:26.161466 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:13:26.161432 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3e1c01_18f0_46ca_920e_8aeb3d91d380.slice/crio-23f3b3004bff6aa2cca7ff86bb89e9ba8a11b7164b0a7b9ec179d39b24c6175a WatchSource:0}: Error finding container 23f3b3004bff6aa2cca7ff86bb89e9ba8a11b7164b0a7b9ec179d39b24c6175a: Status 404 returned error can't find the container with id 23f3b3004bff6aa2cca7ff86bb89e9ba8a11b7164b0a7b9ec179d39b24c6175a Jun 03 23:13:26.163252 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:26.163236 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:13:26.790557 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:26.790518 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" event={"ID":"1d3e1c01-18f0-46ca-920e-8aeb3d91d380","Type":"ContainerStarted","Data":"23f3b3004bff6aa2cca7ff86bb89e9ba8a11b7164b0a7b9ec179d39b24c6175a"} Jun 03 23:13:28.802132 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:28.802088 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" event={"ID":"1d3e1c01-18f0-46ca-920e-8aeb3d91d380","Type":"ContainerStarted","Data":"89e85a8491689303fe7102657e65c9dcdf64862d44df7c525d234c75cb6b8f8d"} Jun 03 23:13:28.802531 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:28.802196 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:13:28.836128 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:28.836079 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" podStartSLOduration=1.698362064 podStartE2EDuration="3.836061582s" totalImagesPullingTime="2.137699518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:13:28.835067823 +0000 UTC m=+653.473160571" watchObservedRunningTime="2026-06-03 23:13:28.836061582 +0000 UTC m=+653.474154329" Jun 03 23:13:39.809680 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:13:39.809604 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-gqzd9" Jun 03 23:14:23.223859 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.223778 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9"] Jun 03 23:14:23.226347 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.226330 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.229786 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.229759 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:14:23.229930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.229855 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 23:14:23.229930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.229872 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tvs66\"" Jun 03 23:14:23.229930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.229856 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:14:23.240138 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.240108 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9"] Jun 03 23:14:23.323889 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.323853 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b5d109-9147-479d-87c1-760b3487f9cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.324081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.323893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7t94\" (UniqueName: \"kubernetes.io/projected/d0b5d109-9147-479d-87c1-760b3487f9cc-kube-api-access-s7t94\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.324081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.323920 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.324081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.324021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.324081 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.324061 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.324237 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.324134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425297 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425257 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b5d109-9147-479d-87c1-760b3487f9cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425297 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425297 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7t94\" (UniqueName: \"kubernetes.io/projected/d0b5d109-9147-479d-87c1-760b3487f9cc-kube-api-access-s7t94\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425546 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425333 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425546 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425376 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425546 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425393 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425546 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425419 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425860 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425937 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425884 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.425937 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.425902 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.427628 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.427605 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b5d109-9147-479d-87c1-760b3487f9cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.427802 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.427784 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b5d109-9147-479d-87c1-760b3487f9cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.433487 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.433463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7t94\" (UniqueName: \"kubernetes.io/projected/d0b5d109-9147-479d-87c1-760b3487f9cc-kube-api-access-s7t94\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9\" (UID: \"d0b5d109-9147-479d-87c1-760b3487f9cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.537815 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.537730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:23.676947 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.676825 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9"] Jun 03 23:14:23.679785 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:14:23.679760 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b5d109_9147_479d_87c1_760b3487f9cc.slice/crio-3e6137c8c73d1910c4ed4c479627e8f74baeb2dd13b9c321f3e4f20095c676c1 WatchSource:0}: Error finding container 3e6137c8c73d1910c4ed4c479627e8f74baeb2dd13b9c321f3e4f20095c676c1: Status 404 returned error can't find the container with id 3e6137c8c73d1910c4ed4c479627e8f74baeb2dd13b9c321f3e4f20095c676c1 Jun 03 23:14:23.914012 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:23.913970 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:14:24.059387 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:24.059350 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" event={"ID":"d0b5d109-9147-479d-87c1-760b3487f9cc","Type":"ContainerStarted","Data":"3e6137c8c73d1910c4ed4c479627e8f74baeb2dd13b9c321f3e4f20095c676c1"} Jun 03 23:14:27.082369 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:27.082335 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" event={"ID":"d0b5d109-9147-479d-87c1-760b3487f9cc","Type":"ContainerStarted","Data":"11069d6786f249f22b066acb9c25196357f019de5d2513a762a557b2b0ec7e81"} Jun 03 23:14:29.092070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:29.092036 2552 generic.go:356] "Generic (PLEG): container finished" podID="d0b5d109-9147-479d-87c1-760b3487f9cc" containerID="11069d6786f249f22b066acb9c25196357f019de5d2513a762a557b2b0ec7e81" exitCode=0 Jun 03 23:14:29.092575 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:29.092108 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" event={"ID":"d0b5d109-9147-479d-87c1-760b3487f9cc","Type":"ContainerDied","Data":"11069d6786f249f22b066acb9c25196357f019de5d2513a762a557b2b0ec7e81"} Jun 03 23:14:31.103642 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:31.103609 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" event={"ID":"d0b5d109-9147-479d-87c1-760b3487f9cc","Type":"ContainerStarted","Data":"bc8c78a59e89fe7eb26a04057c099a514662e1ca4ac4a695d9985dc58bf5dac4"} Jun 03 23:14:31.126067 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:31.126014 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" podStartSLOduration=2.324526556 podStartE2EDuration="8.125998403s" totalImagesPullingTime="4.466543958s" totalInitContainerRuntime="1.334927889s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:14:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:14:31.123900786 +0000 UTC m=+715.761993534" watchObservedRunningTime="2026-06-03 23:14:31.125998403 +0000 UTC m=+715.764091150" Jun 03 23:14:33.538228 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:33.538199 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:33.538623 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:33.538252 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:33.553263 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:33.553233 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:34.130628 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:34.130599 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9" Jun 03 23:14:38.908704 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:38.908664 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:14:46.899224 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.899186 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4"] Jun 03 23:14:46.902967 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.902943 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:46.904982 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.904961 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 23:14:46.910274 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.910246 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4"] Jun 03 23:14:46.913178 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.913121 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:46.913286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.913178 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5l87\" (UniqueName: \"kubernetes.io/projected/c7e1126a-ee76-4f1f-a433-4feca066fe00-kube-api-access-v5l87\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:46.913286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.913202 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:46.913286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.913219 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:46.913286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.913260 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7e1126a-ee76-4f1f-a433-4feca066fe00-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:46.913286 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:46.913286 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.014508 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.014469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.014740 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.014522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5l87\" (UniqueName: \"kubernetes.io/projected/c7e1126a-ee76-4f1f-a433-4feca066fe00-kube-api-access-v5l87\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.014740 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.014555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.014740 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.014578 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.014740 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.014636 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7e1126a-ee76-4f1f-a433-4feca066fe00-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.014740 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.014689 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.015070 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.015048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.015140 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.015094 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.015140 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.015107 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.016830 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.016804 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7e1126a-ee76-4f1f-a433-4feca066fe00-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.017241 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.017219 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7e1126a-ee76-4f1f-a433-4feca066fe00-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.023539 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.023516 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5l87\" (UniqueName: \"kubernetes.io/projected/c7e1126a-ee76-4f1f-a433-4feca066fe00-kube-api-access-v5l87\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4\" (UID: \"c7e1126a-ee76-4f1f-a433-4feca066fe00\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.215423 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.215329 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:47.346565 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.346540 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4"] Jun 03 23:14:47.348984 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:14:47.348960 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e1126a_ee76_4f1f_a433_4feca066fe00.slice/crio-c519bda7cb984e58880adea8c74e441d8dc726ba6fa413ef0da0a49529e9cb3b WatchSource:0}: Error finding container c519bda7cb984e58880adea8c74e441d8dc726ba6fa413ef0da0a49529e9cb3b: Status 404 returned error can't find the container with id c519bda7cb984e58880adea8c74e441d8dc726ba6fa413ef0da0a49529e9cb3b Jun 03 23:14:47.697883 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:47.697849 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:14:48.182929 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:48.182864 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" event={"ID":"c7e1126a-ee76-4f1f-a433-4feca066fe00","Type":"ContainerStarted","Data":"a4fc892c36a0102020dd3998c5bac78af4a396b1f8811fa73dc34255341638b1"} Jun 03 23:14:48.183297 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:48.182957 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" event={"ID":"c7e1126a-ee76-4f1f-a433-4feca066fe00","Type":"ContainerStarted","Data":"c519bda7cb984e58880adea8c74e441d8dc726ba6fa413ef0da0a49529e9cb3b"} Jun 03 23:14:49.189331 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:49.189294 2552 generic.go:356] "Generic (PLEG): container finished" podID="c7e1126a-ee76-4f1f-a433-4feca066fe00" containerID="a4fc892c36a0102020dd3998c5bac78af4a396b1f8811fa73dc34255341638b1" exitCode=0 Jun 03 23:14:49.189733 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:49.189377 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" event={"ID":"c7e1126a-ee76-4f1f-a433-4feca066fe00","Type":"ContainerDied","Data":"a4fc892c36a0102020dd3998c5bac78af4a396b1f8811fa73dc34255341638b1"} Jun 03 23:14:50.196498 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:50.196459 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" event={"ID":"c7e1126a-ee76-4f1f-a433-4feca066fe00","Type":"ContainerStarted","Data":"c1fcb64ed12f7b6695c744715ec692a55f5fac210fd96f023b6cddcd791ea8ca"} Jun 03 23:14:50.217114 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:50.217061 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" podStartSLOduration=2.545976751 podStartE2EDuration="4.217045695s" totalImagesPullingTime="293.358809ms" totalInitContainerRuntime="1.377710135s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:14:50.214930029 +0000 UTC m=+734.853022778" watchObservedRunningTime="2026-06-03 23:14:50.217045695 +0000 UTC m=+734.855138467" Jun 03 23:14:57.216139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:57.216083 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:57.216682 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:57.216170 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:57.229026 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:57.228992 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:14:57.241685 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:14:57.241642 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4" Jun 03 23:15:03.386182 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.386143 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr"] Jun 03 23:15:03.389595 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.389573 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.392113 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.392088 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 23:15:03.398434 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.398403 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr"] Jun 03 23:15:03.461095 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.461058 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc07d20-d2f8-4858-8177-8668a323ed2a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.461293 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.461124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmhq\" (UniqueName: \"kubernetes.io/projected/5fc07d20-d2f8-4858-8177-8668a323ed2a-kube-api-access-pqmhq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.461293 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.461153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.461293 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.461180 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.461455 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.461304 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.461455 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.461363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562136 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562099 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562136 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562147 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562362 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562271 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc07d20-d2f8-4858-8177-8668a323ed2a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562362 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmhq\" (UniqueName: \"kubernetes.io/projected/5fc07d20-d2f8-4858-8177-8668a323ed2a-kube-api-access-pqmhq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562458 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562371 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562458 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562395 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562555 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562753 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.562873 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.562739 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.564861 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.564835 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc07d20-d2f8-4858-8177-8668a323ed2a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.565139 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.565118 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc07d20-d2f8-4858-8177-8668a323ed2a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.573819 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.573794 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmhq\" (UniqueName: \"kubernetes.io/projected/5fc07d20-d2f8-4858-8177-8668a323ed2a-kube-api-access-pqmhq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr\" (UID: \"5fc07d20-d2f8-4858-8177-8668a323ed2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.702549 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.702446 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:03.863212 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:03.863157 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr"] Jun 03 23:15:03.865539 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:15:03.865514 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc07d20_d2f8_4858_8177_8668a323ed2a.slice/crio-ebd55d5f1d8210c0faef12f738df04f93fee80cc409f350a19b50caa02e4c346 WatchSource:0}: Error finding container ebd55d5f1d8210c0faef12f738df04f93fee80cc409f350a19b50caa02e4c346: Status 404 returned error can't find the container with id ebd55d5f1d8210c0faef12f738df04f93fee80cc409f350a19b50caa02e4c346 Jun 03 23:15:04.272517 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:04.272471 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" event={"ID":"5fc07d20-d2f8-4858-8177-8668a323ed2a","Type":"ContainerStarted","Data":"b8add67d3a0b98228e46b569754885e2d07f1b726a33e2b887a5a31d87bc3559"} Jun 03 23:15:04.272737 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:04.272532 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" event={"ID":"5fc07d20-d2f8-4858-8177-8668a323ed2a","Type":"ContainerStarted","Data":"ebd55d5f1d8210c0faef12f738df04f93fee80cc409f350a19b50caa02e4c346"} Jun 03 23:15:04.402798 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:04.402754 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:15:05.279236 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:05.279195 2552 generic.go:356] "Generic (PLEG): container finished" podID="5fc07d20-d2f8-4858-8177-8668a323ed2a" containerID="b8add67d3a0b98228e46b569754885e2d07f1b726a33e2b887a5a31d87bc3559" exitCode=0 Jun 03 23:15:05.279432 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:05.279277 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" event={"ID":"5fc07d20-d2f8-4858-8177-8668a323ed2a","Type":"ContainerDied","Data":"b8add67d3a0b98228e46b569754885e2d07f1b726a33e2b887a5a31d87bc3559"} Jun 03 23:15:06.286004 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:06.285967 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" event={"ID":"5fc07d20-d2f8-4858-8177-8668a323ed2a","Type":"ContainerStarted","Data":"4e566d025ed9b8192f808618619d62efadedf37418de885acd2096246bbecb8f"} Jun 03 23:15:06.306026 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:06.305968 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" podStartSLOduration=1.814755474 podStartE2EDuration="3.305948699s" totalImagesPullingTime="239.493079ms" totalInitContainerRuntime="1.251700146s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:15:06.304749473 +0000 UTC m=+750.942842221" watchObservedRunningTime="2026-06-03 23:15:06.305948699 +0000 UTC m=+750.944041447" Jun 03 23:15:13.703170 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:13.703117 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:13.703617 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:13.703214 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:13.715957 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:13.715929 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:14.337880 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.337850 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr" Jun 03 23:15:14.414195 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.414163 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8"] Jun 03 23:15:14.416938 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.416917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.419147 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.419127 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 23:15:14.427037 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.427013 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8"] Jun 03 23:15:14.558616 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.558577 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.558893 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.558629 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.558893 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.558776 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a0e176-c120-430f-8a14-889d54f0b373-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.558893 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.558817 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.558893 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.558837 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.559078 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.558907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kf9s\" (UniqueName: \"kubernetes.io/projected/82a0e176-c120-430f-8a14-889d54f0b373-kube-api-access-8kf9s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659553 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659461 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a0e176-c120-430f-8a14-889d54f0b373-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659553 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659511 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659553 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659526 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659848 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kf9s\" (UniqueName: \"kubernetes.io/projected/82a0e176-c120-430f-8a14-889d54f0b373-kube-api-access-8kf9s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659848 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659848 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659796 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.659996 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.659915 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.660089 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.660066 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.660166 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.660146 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.661848 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.661828 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a0e176-c120-430f-8a14-889d54f0b373-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.662005 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.661987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a0e176-c120-430f-8a14-889d54f0b373-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.667540 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.667517 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kf9s\" (UniqueName: \"kubernetes.io/projected/82a0e176-c120-430f-8a14-889d54f0b373-kube-api-access-8kf9s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8\" (UID: \"82a0e176-c120-430f-8a14-889d54f0b373\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.728852 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.728815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:14.867178 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:14.867151 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8"] Jun 03 23:15:14.869217 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:15:14.869177 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a0e176_c120_430f_8a14_889d54f0b373.slice/crio-cb1b4f3eb8c6c2ff5a1e1e81ca668ee5749aa632fed546df7d64b4734b61ec96 WatchSource:0}: Error finding container cb1b4f3eb8c6c2ff5a1e1e81ca668ee5749aa632fed546df7d64b4734b61ec96: Status 404 returned error can't find the container with id cb1b4f3eb8c6c2ff5a1e1e81ca668ee5749aa632fed546df7d64b4734b61ec96 Jun 03 23:15:15.334179 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:15.334105 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" event={"ID":"82a0e176-c120-430f-8a14-889d54f0b373","Type":"ContainerStarted","Data":"55351099b93800ac487546057952d2a2b8e30850ad877da14bd34518fea1d465"} Jun 03 23:15:15.334179 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:15.334181 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" event={"ID":"82a0e176-c120-430f-8a14-889d54f0b373","Type":"ContainerStarted","Data":"cb1b4f3eb8c6c2ff5a1e1e81ca668ee5749aa632fed546df7d64b4734b61ec96"} Jun 03 23:15:16.103399 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:16.103358 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:15:17.348744 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:17.348712 2552 generic.go:356] "Generic (PLEG): container finished" podID="82a0e176-c120-430f-8a14-889d54f0b373" containerID="55351099b93800ac487546057952d2a2b8e30850ad877da14bd34518fea1d465" exitCode=0 Jun 03 23:15:17.349173 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:17.348791 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" event={"ID":"82a0e176-c120-430f-8a14-889d54f0b373","Type":"ContainerDied","Data":"55351099b93800ac487546057952d2a2b8e30850ad877da14bd34518fea1d465"} Jun 03 23:15:18.355222 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:18.355183 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" event={"ID":"82a0e176-c120-430f-8a14-889d54f0b373","Type":"ContainerStarted","Data":"6d39aa0888b24362df7338282fdff9f7a6b429d02fa96204975348cf31e287d3"} Jun 03 23:15:18.395528 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:18.395470 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" podStartSLOduration=2.757093348 podStartE2EDuration="4.395455761s" totalImagesPullingTime="224.176651ms" totalInitContainerRuntime="1.414185762s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:15:18.393770533 +0000 UTC m=+763.031863284" watchObservedRunningTime="2026-06-03 23:15:18.395455761 +0000 UTC m=+763.033548509" Jun 03 23:15:21.467630 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:21.467587 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:15:24.729378 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:24.729339 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:24.729828 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:24.729407 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:24.742637 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:24.742610 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:15:25.398930 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:15:25.398900 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8" Jun 03 23:16:54.215877 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:16:54.215837 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:17:04.815662 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:04.815623 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:17:14.202402 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:14.202309 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:17:23.721688 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:23.721591 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:17:33.022315 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:33.022272 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:17:35.823787 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:35.823759 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:17:35.824357 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:35.824338 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:17:44.006154 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:17:44.006114 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:18:14.748876 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:18:14.748839 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:18:21.210909 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:18:21.210871 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:18:59.510701 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:18:59.510600 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:19:15.158083 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:19:15.158047 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:19:52.807762 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:19:52.807721 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:20:10.900616 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:20:10.900579 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:20:23.513206 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:20:23.513125 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:20:41.208449 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:20:41.208406 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:21:37.501615 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:21:37.501580 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:21:46.703475 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:21:46.703389 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:22:03.005639 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:22:03.005596 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:22:11.710101 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:22:11.710057 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:22:28.213260 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:22:28.213163 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:22:35.853575 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:22:35.853547 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:22:35.856010 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:22:35.855989 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:22:37.209937 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:22:37.209898 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:09.406476 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:09.406432 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:18.103119 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:18.103030 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:26.308277 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:26.308242 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:35.002941 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:35.002897 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:43.510403 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:43.510370 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:49.710602 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:49.710560 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:23:56.599719 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:23:56.599678 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:24:02.510256 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:24:02.510216 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:24:11.712576 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:24:11.712537 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:25:10.408954 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:25:10.408906 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:25:19.399251 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:25:19.399209 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:25:30.106606 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:25:30.106572 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:25:36.908632 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:25:36.908583 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:25:44.209627 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:25:44.209584 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:25:52.706072 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:25:52.706036 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:01.403192 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:01.403150 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:10.110629 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:10.110593 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:21.214363 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:21.214266 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:28.206150 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:28.206110 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:36.816780 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:36.816738 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:45.501776 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:45.501738 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:26:54.345444 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:26:54.345405 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:27:02.408835 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:27:02.408796 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:27:11.116445 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:27:11.116407 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:27:20.204201 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:27:20.204152 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:27:35.883072 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:27:35.883043 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:27:35.887233 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:27:35.887202 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:29:36.683136 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:29:36.683053 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:29:43.813021 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:29:43.812972 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:30:11.308590 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:30:11.308553 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:30:20.913613 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:30:20.913576 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:30:30.212368 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:30:30.212332 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:30:40.008433 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:30:40.008390 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:30:48.724179 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:30:48.724092 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:30:58.702758 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:30:58.702723 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:31:07.711236 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:31:07.711196 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:31:17.597426 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:31:17.597387 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:31:27.907916 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:31:27.907880 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:31:37.099510 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:31:37.099463 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:31:45.711202 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:31:45.711165 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:32:19.132842 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:32:19.132753 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:32:35.917842 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:32:35.917810 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:32:35.920188 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:32:35.920162 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:33:02.107455 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:33:02.107415 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:33:13.608526 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:33:13.608488 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:33:22.719001 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:33:22.718958 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:33:29.902430 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:33:29.902392 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:33:38.708149 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:33:38.708109 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:33:52.513513 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:33:52.513420 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:34:01.900679 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:34:01.900626 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:34:09.805015 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:34:09.804973 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:34:20.303246 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:34:20.303208 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:34:26.803568 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:34:26.803528 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:34:35.302750 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:34:35.302713 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:34:45.701282 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:34:45.701243 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:35:04.207030 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:35:04.206990 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:35:13.509409 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:35:13.509375 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:35:22.711391 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:35:22.711304 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:35:29.506491 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:35:29.506451 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:35:47.219720 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:35:47.219687 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:35:54.209049 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:35:54.209006 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:36:05.107040 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:36:05.107001 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:36:11.504893 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:36:11.504851 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:36:22.511200 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:36:22.511160 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:36:29.807842 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:36:29.807801 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:36:38.423303 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:36:38.423263 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:36:53.009620 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:36:53.009532 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:37:02.208409 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:02.208366 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:37:16.016309 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:16.016273 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:37:26.311760 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:26.311724 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:37:34.708757 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:34.708722 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:37:35.948342 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:35.948311 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:37:35.958696 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:35.958646 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:37:43.211462 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:43.211417 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:37:56.805591 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:37:56.805546 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:38:12.210190 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:38:12.210150 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:38:21.607845 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:38:21.607802 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:38:30.820088 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:38:30.820051 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:38:38.826149 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:38:38.826108 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:39:03.410062 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:03.410026 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:39:16.610856 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:16.610818 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d6x59"] Jun 03 23:39:26.952953 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:26.952923 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-574764c5bd-tqhsk_f60e8d68-324e-4024-9e79-d7f366df304e/nginx/0.log" Jun 03 23:39:27.062161 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:27.062109 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dlzxc_a0e8e55a-ff35-439b-aba1-02deb425c514/manager/0.log" Jun 03 23:39:27.182644 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:27.182593 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rfrhz_ee44e9f9-a392-4ecf-9712-adea7ba90053/manager/0.log" Jun 03 23:39:27.753204 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:27.753175 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9qzw6_6de330dc-23d2-435b-bdb0-9b9cc2234f63/server/0.log" Jun 03 23:39:27.878165 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:27.878129 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-585fh_627b6734-fb25-48c2-89ff-0a8a9d595143/manager/0.log" Jun 03 23:39:28.253208 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:28.253173 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-pnqxx_0114e740-b740-4dd2-ac53-b3f5e73738de/copy-manifests/0.log" Jun 03 23:39:28.259835 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:28.259811 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-pnqxx_0114e740-b740-4dd2-ac53-b3f5e73738de/manager/0.log" Jun 03 23:39:30.343321 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:30.343297 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d6x59_863f56f5-aaa8-45d7-8a4e-9e494072447e/limitador/0.log" Jun 03 23:39:30.462822 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:30.462793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cs2cc_eb606f6b-62b9-49f6-afb4-7f208bee4c4c/manager/0.log" Jun 03 23:39:30.929956 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:30.929903 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8rfb8_4ea8935e-0e2a-4ce7-be44-5beaea143e05/discovery/0.log" Jun 03 23:39:31.041387 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:31.041346 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cd4f89b79-754jz_e30b10fb-f935-4655-aa80-8a39866efd7e/kube-auth-proxy/0.log" Jun 03 23:39:31.399236 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:31.399200 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gqzd9_1d3e1c01-18f0-46ca-920e-8aeb3d91d380/payload-pre-processing/0.log" Jun 03 23:39:31.626564 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:31.626535 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c989f8d7c-7z85d_798d3498-5713-473b-a7b8-ad5e9fe6f658/router/0.log" Jun 03 23:39:31.966317 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:31.966278 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9_d0b5d109-9147-479d-87c1-760b3487f9cc/main/0.log" Jun 03 23:39:31.973250 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:31.973223 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-rw7f9_d0b5d109-9147-479d-87c1-760b3487f9cc/storage-initializer/0.log" Jun 03 23:39:32.210250 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:32.210220 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4_c7e1126a-ee76-4f1f-a433-4feca066fe00/storage-initializer/0.log" Jun 03 23:39:32.218882 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:32.218811 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gq5j4_c7e1126a-ee76-4f1f-a433-4feca066fe00/main/0.log" Jun 03 23:39:32.333253 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:32.333218 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr_5fc07d20-d2f8-4858-8177-8668a323ed2a/storage-initializer/0.log" Jun 03 23:39:32.341292 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:32.341272 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cl8tmr_5fc07d20-d2f8-4858-8177-8668a323ed2a/main/0.log" Jun 03 23:39:32.445790 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:32.445763 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8_82a0e176-c120-430f-8a14-889d54f0b373/storage-initializer/0.log" Jun 03 23:39:32.454020 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:32.453985 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8vnl8_82a0e176-c120-430f-8a14-889d54f0b373/main/0.log" Jun 03 23:39:39.645639 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:39.645583 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z4ld4_d71ee51b-4b7e-43db-b863-8fef4edf3c04/global-pull-secret-syncer/0.log" Jun 03 23:39:39.829068 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:39.829038 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p7r47_11117f0e-3040-496c-99d7-8b958ff3ae22/konnectivity-agent/0.log" Jun 03 23:39:39.968335 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:39.968241 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-203.ec2.internal_9af29b3c0ed1e2d0969b0e864a816d25/haproxy/0.log" Jun 03 23:39:42.965646 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:42.965612 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-zz9tq_68018154-f2fe-4064-a840-051a513bbae6/sail-operator/0.log" Jun 03 23:39:45.677325 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:45.677235 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d6x59_863f56f5-aaa8-45d7-8a4e-9e494072447e/limitador/0.log" Jun 03 23:39:45.776171 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:45.776135 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cs2cc_eb606f6b-62b9-49f6-afb4-7f208bee4c4c/manager/0.log" Jun 03 23:39:47.522592 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:47.522557 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-xhfnx_7dec70f7-b883-4149-82ea-c48d0b02ad1a/cluster-monitoring-operator/0.log" Jun 03 23:39:47.959357 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:47.959321 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srm2c_205947be-b42d-437e-82dc-a83be3e4b0bc/node-exporter/0.log" Jun 03 23:39:47.989000 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:47.988958 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srm2c_205947be-b42d-437e-82dc-a83be3e4b0bc/kube-rbac-proxy/0.log" Jun 03 23:39:48.018023 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:48.017994 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srm2c_205947be-b42d-437e-82dc-a83be3e4b0bc/init-textfile/0.log" Jun 03 23:39:50.008363 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:50.008327 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-nkf2l_49f30332-91b0-41a7-b40a-4b54c668c69b/networking-console-plugin/0.log" Jun 03 23:39:50.709356 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:50.709320 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/1.log" Jun 03 23:39:50.717709 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:50.717678 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-pzc9r_8dbc20d5-2bcf-47b3-86d0-9cd73832f899/console-operator/2.log" Jun 03 23:39:51.710769 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.710733 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx"] Jun 03 23:39:51.715080 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.715059 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.716935 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.716906 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmvz\"/\"kube-root-ca.crt\"" Jun 03 23:39:51.717079 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.717054 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmvz\"/\"openshift-service-ca.crt\"" Jun 03 23:39:51.723371 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.723334 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx"] Jun 03 23:39:51.729461 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.729430 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bzmvz\"/\"default-dockercfg-jvmb9\"" Jun 03 23:39:51.844407 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.844366 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-sys\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.844407 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.844419 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-proc\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.844644 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.844516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9ghv\" (UniqueName: \"kubernetes.io/projected/d54b8ed1-c40d-43c8-82ae-120565356297-kube-api-access-k9ghv\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.844644 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.844554 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-podres\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.844644 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.844581 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-lib-modules\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.945920 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.945878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9ghv\" (UniqueName: \"kubernetes.io/projected/d54b8ed1-c40d-43c8-82ae-120565356297-kube-api-access-k9ghv\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946109 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.945931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-podres\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946109 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.945972 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-lib-modules\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946109 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.946027 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-sys\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946109 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.946071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-proc\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.946133 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-lib-modules\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.946136 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-podres\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.946171 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-proc\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.946308 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.946175 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54b8ed1-c40d-43c8-82ae-120565356297-sys\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:51.954842 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:51.954820 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9ghv\" (UniqueName: \"kubernetes.io/projected/d54b8ed1-c40d-43c8-82ae-120565356297-kube-api-access-k9ghv\") pod \"perf-node-gather-daemonset-b9tkx\" (UID: \"d54b8ed1-c40d-43c8-82ae-120565356297\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:52.031508 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.031407 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:52.063993 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.063960 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-c6lnq_1c62a181-9541-49a9-968a-0a3fe29ef5fb/volume-data-source-validator/0.log" Jun 03 23:39:52.174662 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.174618 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx"] Jun 03 23:39:52.176710 ip-10-0-138-203 kubenswrapper[2552]: W0603 23:39:52.176681 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd54b8ed1_c40d_43c8_82ae_120565356297.slice/crio-a40f1cfb4faf9a7c0cbd91bc75e5fdac75b2430dfb0adeb32bb3cf8077b38888 WatchSource:0}: Error finding container a40f1cfb4faf9a7c0cbd91bc75e5fdac75b2430dfb0adeb32bb3cf8077b38888: Status 404 returned error can't find the container with id a40f1cfb4faf9a7c0cbd91bc75e5fdac75b2430dfb0adeb32bb3cf8077b38888 Jun 03 23:39:52.656307 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.656269 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" event={"ID":"d54b8ed1-c40d-43c8-82ae-120565356297","Type":"ContainerStarted","Data":"e94e13c439aef0b5b40cf4f414cd32d18a940bbd0cb7a37490e335ccd749253f"} Jun 03 23:39:52.656478 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.656324 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" event={"ID":"d54b8ed1-c40d-43c8-82ae-120565356297","Type":"ContainerStarted","Data":"a40f1cfb4faf9a7c0cbd91bc75e5fdac75b2430dfb0adeb32bb3cf8077b38888"} Jun 03 23:39:52.656478 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.656356 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:52.672818 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:52.672756 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" podStartSLOduration=1.6727385890000002 podStartE2EDuration="1.672738589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:39:52.671046656 +0000 UTC m=+2237.309139405" watchObservedRunningTime="2026-06-03 23:39:52.672738589 +0000 UTC m=+2237.310831348" Jun 03 23:39:53.176595 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:53.176560 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pz9vg_d608acf6-e9d4-493d-82f8-bcc5ee9106f9/dns/0.log" Jun 03 23:39:53.201166 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:53.201129 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pz9vg_d608acf6-e9d4-493d-82f8-bcc5ee9106f9/kube-rbac-proxy/0.log" Jun 03 23:39:53.391860 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:53.391833 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rccsq_d5c9433a-4cd9-40d7-8c51-5bf5f211b2c3/dns-node-resolver/0.log" Jun 03 23:39:54.015009 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:54.014974 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fw9vj_4947f5bc-89b0-4d81-be6d-981aaef111fc/node-ca/0.log" Jun 03 23:39:55.171352 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:55.171315 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8rfb8_4ea8935e-0e2a-4ce7-be44-5beaea143e05/discovery/0.log" Jun 03 23:39:55.200420 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:55.200393 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cd4f89b79-754jz_e30b10fb-f935-4655-aa80-8a39866efd7e/kube-auth-proxy/0.log" Jun 03 23:39:55.398239 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:55.398201 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gqzd9_1d3e1c01-18f0-46ca-920e-8aeb3d91d380/payload-pre-processing/0.log" Jun 03 23:39:55.531430 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:55.531328 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c989f8d7c-7z85d_798d3498-5713-473b-a7b8-ad5e9fe6f658/router/0.log" Jun 03 23:39:56.183283 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:56.183250 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fkq6s_b32101c5-6407-4b0b-8795-f985fd873544/serve-healthcheck-canary/0.log" Jun 03 23:39:56.767082 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:56.767043 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-5bb94_0d79e31f-a188-4619-96e6-8c24e88d8956/insights-operator/0.log" Jun 03 23:39:56.767793 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:56.767771 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-5bb94_0d79e31f-a188-4619-96e6-8c24e88d8956/insights-operator/1.log" Jun 03 23:39:56.820796 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:56.820760 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dxs99_e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1/kube-rbac-proxy/0.log" Jun 03 23:39:56.868707 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:56.868645 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dxs99_e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1/exporter/0.log" Jun 03 23:39:56.908144 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:56.908115 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dxs99_e878b2b2-e1c7-4a37-9b4e-0fe2a005e4d1/extractor/0.log" Jun 03 23:39:58.671866 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:58.671837 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-b9tkx" Jun 03 23:39:59.573474 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:59.573445 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-574764c5bd-tqhsk_f60e8d68-324e-4024-9e79-d7f366df304e/nginx/0.log" Jun 03 23:39:59.600256 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:59.600218 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dlzxc_a0e8e55a-ff35-439b-aba1-02deb425c514/manager/0.log" Jun 03 23:39:59.725814 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:59.725777 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rfrhz_ee44e9f9-a392-4ecf-9712-adea7ba90053/manager/0.log" Jun 03 23:39:59.966517 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:39:59.966486 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9qzw6_6de330dc-23d2-435b-bdb0-9b9cc2234f63/server/0.log" Jun 03 23:40:00.041192 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:00.041161 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-585fh_627b6734-fb25-48c2-89ff-0a8a9d595143/manager/0.log" Jun 03 23:40:00.327242 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:00.327216 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-pnqxx_0114e740-b740-4dd2-ac53-b3f5e73738de/manager/0.log" Jun 03 23:40:00.352229 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:00.352204 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-pnqxx_0114e740-b740-4dd2-ac53-b3f5e73738de/copy-manifests/0.log" Jun 03 23:40:05.725329 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:05.725292 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8rfb8_4ea8935e-0e2a-4ce7-be44-5beaea143e05/discovery/0.log" Jun 03 23:40:05.739980 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:05.739926 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cd4f89b79-754jz_e30b10fb-f935-4655-aa80-8a39866efd7e/kube-auth-proxy/0.log" Jun 03 23:40:05.897370 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:05.897310 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gqzd9_1d3e1c01-18f0-46ca-920e-8aeb3d91d380/payload-pre-processing/0.log" Jun 03 23:40:06.010480 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:06.010374 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c989f8d7c-7z85d_798d3498-5713-473b-a7b8-ad5e9fe6f658/router/0.log" Jun 03 23:40:07.259874 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:07.259838 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8rfb8_4ea8935e-0e2a-4ce7-be44-5beaea143e05/discovery/0.log" Jun 03 23:40:07.275341 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:07.275316 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cd4f89b79-754jz_e30b10fb-f935-4655-aa80-8a39866efd7e/kube-auth-proxy/0.log" Jun 03 23:40:07.435667 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:07.435622 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gqzd9_1d3e1c01-18f0-46ca-920e-8aeb3d91d380/payload-pre-processing/0.log" Jun 03 23:40:07.559383 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:07.559282 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c989f8d7c-7z85d_798d3498-5713-473b-a7b8-ad5e9fe6f658/router/0.log" Jun 03 23:40:08.124857 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:08.124821 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8_890cc999-5596-41e2-b811-6866c04be7f9/kube-storage-version-migrator-operator/1.log" Jun 03 23:40:08.126431 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:08.126402 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-rnrk8_890cc999-5596-41e2-b811-6866c04be7f9/kube-storage-version-migrator-operator/0.log" Jun 03 23:40:09.451907 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:09.451867 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8rfb8_4ea8935e-0e2a-4ce7-be44-5beaea143e05/discovery/0.log" Jun 03 23:40:09.462469 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:09.462441 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cd4f89b79-754jz_e30b10fb-f935-4655-aa80-8a39866efd7e/kube-auth-proxy/0.log" Jun 03 23:40:09.624347 ip-10-0-138-203 kubenswrapper[2552]: I0603 23:40:09.624315 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gqzd9_1d3e1c01-18f0-46ca-920e-8aeb3d91d380/payload-pre-processing/0.log"