Jun 03 23:21:49.545673 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 23:21:49.545759 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 23:21:49.545768 ip-10-0-138-87 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 23:21:49.545968 ip-10-0-138-87 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 23:21:59.657408 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 23:21:59.657424 ip-10-0-138-87 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 345711d995614e8e93e42ae12914b67d -- Jun 03 23:24:32.627225 ip-10-0-138-87 systemd[1]: Starting Kubernetes Kubelet... Jun 03 23:24:33.053334 ip-10-0-138-87 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:33.053334 ip-10-0-138-87 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 23:24:33.053334 ip-10-0-138-87 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:33.053334 ip-10-0-138-87 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 23:24:33.053334 ip-10-0-138-87 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:33.055828 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.055733 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 23:24:33.060490 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060458 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:33.060490 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060491 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:33.060490 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060496 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:33.060490 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060499 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060505 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060510 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060513 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060516 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060520 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060523 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060526 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060529 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060532 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060536 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060540 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060543 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060546 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060549 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060552 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060555 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060558 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060560 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:33.060626 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060563 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060566 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060569 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060572 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060575 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060578 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060626 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060871 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060881 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060886 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060892 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060897 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060901 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060907 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060917 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060923 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060928 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060933 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060938 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:33.061277 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060948 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060953 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060957 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060961 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060966 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060970 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060974 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060978 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060982 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060986 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060990 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060995 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.060999 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061009 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061013 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061018 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061023 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061027 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061031 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061036 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:33.062000 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061042 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061048 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061052 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061056 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061061 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061070 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061074 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061078 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061083 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061087 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061092 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061096 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061100 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061104 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061108 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061113 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061117 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061122 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061134 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061139 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:33.062535 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061143 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061147 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061152 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061156 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061160 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061165 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061170 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061177 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061181 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061186 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061196 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061200 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061205 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061210 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061214 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061219 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.061224 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062526 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062537 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062541 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:33.063082 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062545 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062548 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062551 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062555 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062560 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062563 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062566 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062569 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062572 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062575 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062578 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062581 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062583 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062586 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062588 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062591 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062594 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062596 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062598 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062601 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:33.063562 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062604 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062606 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062609 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062612 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062615 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062617 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062620 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062623 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062626 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062629 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062632 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062635 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062638 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062641 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062644 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062646 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062650 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062653 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062656 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:33.064104 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062659 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062662 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062665 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062667 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062670 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062673 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062675 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062678 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062681 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062684 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062686 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062689 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062692 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062695 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062697 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062702 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062706 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062709 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062712 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:33.064579 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062715 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062717 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062720 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062722 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062726 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062729 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062731 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062734 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062736 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062739 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062742 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062744 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062747 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062749 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062752 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062754 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062757 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062759 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062762 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062765 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:33.065071 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062768 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062771 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062773 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062776 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062779 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062782 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062784 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062787 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062789 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062792 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062795 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062797 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062800 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062803 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062805 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062808 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.062811 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063267 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063273 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063276 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:33.065564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063279 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063281 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063284 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063287 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063290 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063292 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063295 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063298 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063300 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063303 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063312 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063315 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063317 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063320 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063323 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063325 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063328 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063332 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:33.066083 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063336 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063339 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063343 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063346 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063349 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063352 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063379 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063383 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063387 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063390 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063394 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063396 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063399 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063402 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063404 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063407 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063410 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063412 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063415 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063418 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:33.066557 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063420 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063423 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063426 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063428 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063432 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063440 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063443 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063446 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063448 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063451 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063453 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063456 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063458 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063461 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063464 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063467 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063470 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063472 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063475 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:33.067059 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063478 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063482 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063485 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063488 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063491 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063494 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063496 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063499 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063501 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063504 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063506 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063508 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063511 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063514 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063516 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063519 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063521 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063524 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063526 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063534 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:33.067528 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063537 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063541 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063543 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063546 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063548 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063551 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063553 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063559 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063561 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063564 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063567 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063570 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063573 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063576 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063578 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063581 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063583 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.063586 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063661 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063673 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063686 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 23:24:33.068027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063690 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063694 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063698 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063702 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063707 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063710 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063713 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063717 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063720 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063723 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063726 2568 flags.go:64] FLAG: --cgroup-root="" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063736 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063739 2568 flags.go:64] FLAG: --client-ca-file="" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063742 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063745 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063753 2568 flags.go:64] FLAG: --cluster-domain="" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063756 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063759 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063764 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063768 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063771 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063775 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063781 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 23:24:33.068590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063784 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063787 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063790 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063793 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063796 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063799 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063803 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063806 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063809 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063812 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063815 2568 flags.go:64] FLAG: --enable-server="true" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063818 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063825 2568 flags.go:64] FLAG: --event-burst="100" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063829 2568 flags.go:64] FLAG: --event-qps="50" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063831 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063834 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063855 2568 flags.go:64] FLAG: --eviction-hard="" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063861 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063865 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063870 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063874 2568 flags.go:64] FLAG: --eviction-soft="" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063884 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063887 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063890 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063893 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 23:24:33.069177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063896 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063899 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063903 2568 flags.go:64] FLAG: --feature-gates="" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063907 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063910 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063914 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063919 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063922 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063925 2568 flags.go:64] FLAG: --help="false" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063928 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063931 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063934 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063937 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063940 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063944 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063947 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063950 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063952 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063956 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063958 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063962 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063964 2568 flags.go:64] FLAG: --kube-reserved="" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063967 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063970 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 23:24:33.069830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063973 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063976 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063979 2568 flags.go:64] FLAG: --lock-file="" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063982 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063985 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.063997 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064002 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064005 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064008 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064010 2568 flags.go:64] FLAG: --logging-format="text" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064019 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064022 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064025 2568 flags.go:64] FLAG: --manifest-url="" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064028 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064034 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064037 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064041 2568 flags.go:64] FLAG: --max-pods="110" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064044 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064047 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064050 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064053 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064056 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064059 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064062 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064069 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 23:24:33.070474 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064072 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064075 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064078 2568 flags.go:64] FLAG: --pod-cidr="" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064081 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064087 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064090 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064093 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064096 2568 flags.go:64] FLAG: --port="10250" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064099 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064102 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0752efa32d15e4b72" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064106 2568 flags.go:64] FLAG: --qos-reserved="" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064109 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064112 2568 flags.go:64] FLAG: --register-node="true" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064121 2568 flags.go:64] FLAG: --register-with-taints="" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064124 2568 flags.go:64] FLAG: --registry-burst="10" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064128 2568 flags.go:64] FLAG: --registry-qps="5" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064130 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064135 2568 flags.go:64] FLAG: --reserved-memory="" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064138 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064141 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064144 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064147 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064152 2568 flags.go:64] FLAG: --runonce="false" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064154 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064158 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 23:24:33.071160 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064161 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064164 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064167 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064169 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064173 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064176 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064179 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064182 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064184 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064187 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064190 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064193 2568 flags.go:64] FLAG: --system-cgroups="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064196 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064201 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064204 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064207 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064213 2568 flags.go:64] FLAG: --tls-min-version="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064216 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064219 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064221 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064224 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064233 2568 flags.go:64] FLAG: --v="2" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064237 2568 flags.go:64] FLAG: --version="false" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064241 2568 flags.go:64] FLAG: --vmodule="" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064246 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 23:24:33.071970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.064250 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064398 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064404 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064408 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064412 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064415 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064418 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064422 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064425 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064428 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064431 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064433 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064436 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064439 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064442 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064445 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064447 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064450 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064452 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064455 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:33.072628 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064458 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064460 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064463 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064466 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064468 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064470 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064473 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064476 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064479 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064488 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064490 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064494 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064497 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064500 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064503 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064509 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064513 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064515 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064518 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064521 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:33.073145 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064523 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064526 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064528 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064531 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064534 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064538 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064542 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064545 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064548 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064551 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064553 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064556 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064558 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064561 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064564 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064567 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064569 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064572 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064576 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:33.073635 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064579 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064583 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064587 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064596 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064601 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064604 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064606 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064609 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064612 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064616 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064619 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064622 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064624 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064627 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064630 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064632 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064635 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064638 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064640 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064643 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:33.074111 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064646 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064649 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064651 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064654 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064657 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064659 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064662 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064664 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064667 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064670 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064672 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064675 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064678 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064680 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064683 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064685 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064694 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064697 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064700 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:33.074603 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.064702 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.065296 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.072186 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.072206 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.072227 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.072234 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072302 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072307 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072310 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072313 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072317 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072319 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072322 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072325 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072328 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:33.075073 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072331 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072334 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072337 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072339 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072342 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072345 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072348 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072350 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072353 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072356 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072359 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072362 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072365 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072368 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072371 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072374 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072385 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072388 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072391 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072393 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:33.075446 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072397 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072401 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072404 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072408 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072412 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072415 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072418 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072421 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072423 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072426 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072428 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072431 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072434 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072437 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072439 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072442 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072445 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072447 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072450 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:33.076037 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072453 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072457 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072459 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072462 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072465 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072468 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072471 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072473 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072476 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072479 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072481 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072484 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072486 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072489 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072493 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072496 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072499 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072502 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072504 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:33.076495 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072507 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072509 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072512 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072514 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072517 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072520 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072523 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072525 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072528 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072531 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072534 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072536 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072539 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072541 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072544 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072547 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072550 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072553 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072555 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072559 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:33.076961 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072563 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072566 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072569 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072572 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072574 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072577 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072581 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072585 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072588 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072592 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072594 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.072599 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072721 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072724 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:33.077447 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072728 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072731 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072734 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072737 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072740 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072743 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072746 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072749 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072751 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072754 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072757 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072760 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072763 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072766 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072768 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072771 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072773 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072777 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072779 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072782 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:33.077795 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072785 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072787 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072790 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072793 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072796 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072799 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072801 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072804 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072807 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072809 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072812 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072814 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072817 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072820 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072822 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072825 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072827 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072830 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072832 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072835 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:33.078313 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072850 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072853 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072856 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072859 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072861 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072864 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072867 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072870 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072872 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072875 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072878 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072880 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072883 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072886 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072888 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072891 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072894 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072897 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072900 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072903 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:33.078797 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072907 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072910 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072913 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072916 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072918 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072921 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072925 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072928 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072931 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072934 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072938 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072941 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072944 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072947 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072950 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072954 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072957 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072960 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072963 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:33.079300 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072966 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072970 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072973 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072975 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072978 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072981 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072983 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072986 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072989 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072992 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072994 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.072997 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.073001 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.073003 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.073007 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.073010 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:33.079756 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:33.073012 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.073017 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.073144 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.075491 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.077019 2568 server.go:1019] "Starting client certificate rotation" Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.077122 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.077180 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:24:33.080226 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.079824 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:24:33.081001 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.080974 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:24:33.094285 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.094259 2568 log.go:25] "Validated CRI v1 runtime API" Jun 03 23:24:33.097408 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.097391 2568 log.go:25] "Validated CRI v1 image API" Jun 03 23:24:33.098401 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.098382 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 23:24:33.101822 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.101795 2568 fs.go:135] Filesystem UUIDs: map[3e3b1c04-2064-48ed-80b3-c5b4ca772892:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ccc1bacb-9006-4eca-a5fd-6a748d439e4d:/dev/nvme0n1p3] Jun 03 23:24:33.101822 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.101816 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 23:24:33.106252 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.106231 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:24:33.108711 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.108588 2568 manager.go:216] Machine: {Timestamp:2026-06-03 23:24:33.107139639 +0000 UTC m=+0.356981752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099730 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ef2aa5cd859986281f8a22a1a5f5c SystemUUID:ec2ef2aa-5cd8-5998-6281-f8a22a1a5f5c BootID:345711d9-9561-4e8e-93e4-2ae12914b67d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bd:74:41:a4:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bd:74:41:a4:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:73:60:0c:8c:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 23:24:33.108711 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.108707 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 23:24:33.108853 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.108807 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 23:24:33.112722 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.112692 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 23:24:33.112887 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.112726 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 23:24:33.113567 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.113557 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 23:24:33.113599 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.113570 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 23:24:33.113599 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.113578 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:24:33.114541 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.114529 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:24:33.115420 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.115407 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 23:24:33.118515 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118485 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:24:33.118642 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118632 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 23:24:33.118673 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118669 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 03 23:24:33.118700 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118680 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 23:24:33.118700 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118696 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 23:24:33.118761 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118722 2568 kubelet.go:398] "Adding apiserver pod source" Jun 03 23:24:33.118761 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.118732 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 23:24:33.119135 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.119118 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:24:33.119235 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.119142 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:24:33.122917 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.122892 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 23:24:33.125005 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.124990 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 23:24:33.125088 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.125021 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 23:24:33.125525 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.125498 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bltp" Jun 03 23:24:33.126045 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126033 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 23:24:33.126082 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126050 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 23:24:33.126082 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126056 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 23:24:33.126082 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126062 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 23:24:33.126082 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126072 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 23:24:33.126082 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126077 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 23:24:33.126222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126085 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 23:24:33.126222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126091 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 23:24:33.126222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126098 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 23:24:33.126222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126104 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 23:24:33.126222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126112 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 23:24:33.126222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.126117 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 23:24:33.127014 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.127000 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 23:24:33.127051 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.127020 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 23:24:33.127097 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.126997 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 23:24:33.127097 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.127004 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 23:24:33.130227 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.130204 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 23:24:33.130607 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.130595 2568 server.go:1268] "Started kubelet" Jun 03 23:24:33.130710 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.130683 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 23:24:33.130772 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.130682 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 23:24:33.130811 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.130798 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 23:24:33.131587 ip-10-0-138-87 systemd[1]: Started Kubernetes Kubelet. Jun 03 23:24:33.135953 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.135918 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 23:24:33.136271 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.136246 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bltp" Jun 03 23:24:33.136740 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.136714 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 03 23:24:33.139082 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.139063 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 23:24:33.141813 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.141793 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 23:24:33.141813 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.141811 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 23:24:33.141970 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.141881 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.142419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142383 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 23:24:33.142419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142384 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 23:24:33.142419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142410 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 23:24:33.142602 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142557 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 03 23:24:33.142602 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142565 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 03 23:24:33.142694 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142649 2568 factory.go:55] Registering systemd factory Jun 03 23:24:33.142694 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142667 2568 factory.go:223] Registration of the systemd container factory successfully Jun 03 23:24:33.142918 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142905 2568 factory.go:153] Registering CRI-O factory Jun 03 23:24:33.142975 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142922 2568 factory.go:223] Registration of the crio container factory successfully Jun 03 23:24:33.143025 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.142978 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 23:24:33.143025 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.143005 2568 factory.go:103] Registering Raw factory Jun 03 23:24:33.143025 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.143020 2568 manager.go:1196] Started watching for new ooms in manager Jun 03 23:24:33.143387 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.143374 2568 manager.go:349] Starting recovery of all containers Jun 03 23:24:33.143522 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.141933 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-87.ec2.internal.18b5b5c22433dd64 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-87.ec2.internal,UID:ip-10-0-138-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-87.ec2.internal,},FirstTimestamp:2026-06-03 23:24:33.130560868 +0000 UTC m=+0.380402980,LastTimestamp:2026-06-03 23:24:33.130560868 +0000 UTC m=+0.380402980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-87.ec2.internal,}" Jun 03 23:24:33.151260 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.151082 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:33.152551 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.152528 2568 manager.go:354] Recovery completed Jun 03 23:24:33.154318 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.154296 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.157547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.157533 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.160404 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.160388 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.160449 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.160421 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.160449 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.160432 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.161044 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161026 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 23:24:33.161044 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161040 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 23:24:33.161175 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161056 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:24:33.161175 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161062 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.161885 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161870 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.161946 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161897 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.161946 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.161906 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.162440 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.162429 2568 policy_none.go:49] "None policy: Start" Jun 03 23:24:33.162472 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.162444 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 23:24:33.162472 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.162454 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 23:24:33.163444 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.163433 2568 policy_none.go:47] "Start" Jun 03 23:24:33.202583 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.202562 2568 manager.go:337] "Starting Device Plugin manager" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.202606 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.202620 2568 server.go:87] "Starting device plugin registration server" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.202919 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.202930 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.203048 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.203472 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.203484 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.205974 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.206066 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.216583 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.217814 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.217862 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.217887 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.217960 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 23:24:33.220697 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.220550 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:33.304094 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.303981 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.307463 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.307444 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.307571 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.307476 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.307571 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.307489 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.307571 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.307513 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.315672 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.315654 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.315720 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.315678 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-87.ec2.internal\": node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.318329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.318311 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"] Jun 03 23:24:33.318379 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.318373 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.321246 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.321228 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.321330 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.321259 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.321330 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.321270 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.322608 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.322596 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.322701 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.322684 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.322749 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.322721 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.323972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.323949 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.323972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.323967 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.324091 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.323984 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.324091 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.323988 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.324091 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.323996 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.324091 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.323998 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.325304 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.325289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.325393 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.325313 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:33.326034 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.326019 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:33.326110 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.326042 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:33.326110 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.326052 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:33.329256 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.329238 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.348585 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.348558 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.352893 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.352877 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.429932 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.429899 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.443197 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.443170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.443295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.443200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.443295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.443229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec9151502287c53bc92d18ac37228f32-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"ec9151502287c53bc92d18ac37228f32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.530346 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.530306 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.543588 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.543566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.543646 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.543592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.543646 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.543610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec9151502287c53bc92d18ac37228f32-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"ec9151502287c53bc92d18ac37228f32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.543741 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.543650 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec9151502287c53bc92d18ac37228f32-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"ec9151502287c53bc92d18ac37228f32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.543741 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.543681 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.543741 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.543698 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.631219 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.631011 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.651486 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.651463 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.657250 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:33.657227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 03 23:24:33.731479 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.731438 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.831955 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.831928 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:33.932506 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:33.932426 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.033050 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.033021 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.076570 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.076548 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 23:24:34.077151 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.076705 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:34.077151 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.076733 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:34.133752 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.133725 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.141820 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.141783 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 23:19:33 +0000 UTC" deadline="2028-02-22 21:34:27.953718912 +0000 UTC" Jun 03 23:24:34.141820 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.141813 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15094h9m53.811909096s" Jun 03 23:24:34.177285 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:34.177253 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9151502287c53bc92d18ac37228f32.slice/crio-78bded56c3fbeb199a249d3ccfe80c51f269028c868446d99b3b232285478afa WatchSource:0}: Error finding container 78bded56c3fbeb199a249d3ccfe80c51f269028c868446d99b3b232285478afa: Status 404 returned error can't find the container with id 78bded56c3fbeb199a249d3ccfe80c51f269028c868446d99b3b232285478afa Jun 03 23:24:34.177615 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:34.177591 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39722b944d26a5edbc396c94a76c862.slice/crio-791ed245754b8fe974c4e4626c5127284dba1d708f722f120a19312c29fa3cc4 WatchSource:0}: Error finding container 791ed245754b8fe974c4e4626c5127284dba1d708f722f120a19312c29fa3cc4: Status 404 returned error can't find the container with id 791ed245754b8fe974c4e4626c5127284dba1d708f722f120a19312c29fa3cc4 Jun 03 23:24:34.182915 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.182900 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:24:34.200934 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.200906 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:34.221425 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.221380 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerStarted","Data":"791ed245754b8fe974c4e4626c5127284dba1d708f722f120a19312c29fa3cc4"} Jun 03 23:24:34.222434 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.222408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" event={"ID":"ec9151502287c53bc92d18ac37228f32","Type":"ContainerStarted","Data":"78bded56c3fbeb199a249d3ccfe80c51f269028c868446d99b3b232285478afa"} Jun 03 23:24:34.234596 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.234571 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.335136 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.335097 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.435725 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.435639 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.536214 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.536179 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.637267 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:34.637237 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 03 23:24:34.653965 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.653937 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:34.742955 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.742879 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 03 23:24:34.756301 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.756255 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:24:34.758555 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.758528 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 03 23:24:34.767745 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:34.767723 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:24:35.120273 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.120214 2568 apiserver.go:52] "Watching apiserver" Jun 03 23:24:35.128117 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.128089 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 23:24:35.129495 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.129471 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal","openshift-multus/network-metrics-daemon-hm8cg","kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-jtv8h","openshift-multus/multus-pml5c","openshift-network-diagnostics/network-check-target-b2x65","openshift-network-operator/iptables-alerter-dkn2g","openshift-ovn-kubernetes/ovnkube-node-sr8rp","kube-system/global-pull-secret-syncer-4zng4","kube-system/konnectivity-agent-5b6wc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt","openshift-cluster-node-tuning-operator/tuned-vdxst","openshift-dns/node-resolver-v8jdn","openshift-image-registry/node-ca-cnz2l"] Jun 03 23:24:35.130993 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.130968 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.132782 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.132421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.135130 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.135105 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.136277 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.136254 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.137385 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.137366 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.137488 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.137455 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.137656 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.137628 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 23:24:35.138291 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.138273 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6zqk2\"" Jun 03 23:24:35.138738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.138718 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:35.138831 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.138792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:35.140236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.139991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.140236 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.140049 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:35.141337 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.141305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.141976 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.141955 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.142078 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.141990 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.142163 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142134 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 23:24:35.142163 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142156 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.142295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142192 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 23:24:35.142295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142216 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 23:24:35.142295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142276 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.142295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142291 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 23:24:35.142644 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142629 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.143292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142898 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 23:24:35.143292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142918 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kz25d\"" Jun 03 23:24:35.143292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142931 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.143292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142952 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5rl5k\"" Jun 03 23:24:35.143292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.143080 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 23:24:35.143292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.142900 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xl7gn\"" Jun 03 23:24:35.143590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.143547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.143681 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.143614 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:35.144026 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.144007 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c7766\"" Jun 03 23:24:35.145119 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.145101 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.146580 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.146563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.147151 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.147126 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.147247 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.147174 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-js8gq\"" Jun 03 23:24:35.147547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.147439 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 23:24:35.147547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.147469 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 23:24:35.148187 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.148169 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.148288 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.148173 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 23:24:35.149970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.149941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 23:24:35.150380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.150218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.150380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.150275 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 23:24:35.150380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.150345 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.150380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.150349 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6xlz7\"" Jun 03 23:24:35.151101 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151083 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-slash\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151188 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-systemd\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151188 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151144 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-etc-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151188 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-run-ovn-kubernetes\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151327 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-system-cni-dir\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.151327 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cni-binary-copy\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.151327 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-k8s-cni-cncf-io\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151327 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-dbus\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.151327 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-var-lib-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovnkube-script-lib\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-cni-multus\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-ovn\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-hostroot\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-daemon-config\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151504 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-node-log\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-kubelet\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-cni-bin\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4874c666-a757-4073-b1b2-e5691cded13b-iptables-alerter-script\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jj7t\" (UniqueName: \"kubernetes.io/projected/4874c666-a757-4073-b1b2-e5691cded13b-kube-api-access-7jj7t\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-etc-kubernetes\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caa35324-f4af-4076-92d3-a6f6d67ce265-host\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151689 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/caa35324-f4af-4076-92d3-a6f6d67ce265-serviceca\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-kubelet-config\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151775 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-env-overrides\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2hl\" (UniqueName: \"kubernetes.io/projected/4a8e699f-0555-404f-ba4b-7b40b3de1f79-kube-api-access-vl2hl\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151878 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-conf-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.151925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-cni-netd\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovnkube-config\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.151971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dct9\" (UniqueName: \"kubernetes.io/projected/2fb6564d-f707-40af-81f9-3aae39c4c705-kube-api-access-7dct9\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-cni-binary-copy\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-systemd-units\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb6564d-f707-40af-81f9-3aae39c4c705-tmp-dir\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-cni-bin\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152140 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152190 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rc2f\" (UniqueName: \"kubernetes.io/projected/55062c7a-cad0-49d8-90a0-6e9322eeaef7-kube-api-access-4rc2f\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-run-netns\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmlsf\" (UniqueName: \"kubernetes.io/projected/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-kube-api-access-bmlsf\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fb6564d-f707-40af-81f9-3aae39c4c705-hosts-file\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-os-release\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-cnibin\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.152595 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-multus-certs\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-os-release\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrrl\" (UniqueName: \"kubernetes.io/projected/caa35324-f4af-4076-92d3-a6f6d67ce265-kube-api-access-vsrrl\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-log-socket\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cnibin\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-system-cni-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovn-node-metrics-cert\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-cni-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-netns\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-kubelet\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpv4r\" (UniqueName: \"kubernetes.io/projected/4b9bb195-ad59-45d7-a6b0-cef42803856e-kube-api-access-lpv4r\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152650 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4874c666-a757-4073-b1b2-e5691cded13b-host-slash\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.152679 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-socket-dir-parent\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.153318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.153133 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 23:24:35.153970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.153681 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.153970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.153834 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 23:24:35.153970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.153896 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7zqwp\"" Jun 03 23:24:35.154168 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.154150 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 23:24:35.156411 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.156268 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b22qj\"" Jun 03 23:24:35.157068 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.157052 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:24:35.185107 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.185079 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:24:35.201580 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.201559 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nhf54" Jun 03 23:24:35.207384 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.207359 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nhf54" Jun 03 23:24:35.218166 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.218141 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:35.243992 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.243961 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 23:24:35.253071 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253039 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rc2f\" (UniqueName: \"kubernetes.io/projected/55062c7a-cad0-49d8-90a0-6e9322eeaef7-kube-api-access-4rc2f\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.253071 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-run-netns\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.253331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmlsf\" (UniqueName: \"kubernetes.io/projected/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-kube-api-access-bmlsf\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-sys-fs\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.253331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-run-netns\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.253331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysconfig\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.253331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fb6564d-f707-40af-81f9-3aae39c4c705-hosts-file\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.253331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-os-release\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-cnibin\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fb6564d-f707-40af-81f9-3aae39c4c705-hosts-file\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-multus-certs\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-multus-certs\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253469 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-cnibin\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253461 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-socket-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-os-release\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253519 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-os-release\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrrl\" (UniqueName: \"kubernetes.io/projected/caa35324-f4af-4076-92d3-a6f6d67ce265-kube-api-access-vsrrl\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253574 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-log-socket\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253593 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cnibin\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-system-cni-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.253627 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-var-lib-kubelet\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253654 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-log-socket\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovn-node-metrics-cert\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-cni-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-netns\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-system-cni-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253742 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-os-release\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-kubelet\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpv4r\" (UniqueName: \"kubernetes.io/projected/4b9bb195-ad59-45d7-a6b0-cef42803856e-kube-api-access-lpv4r\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253807 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-cni-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-netns\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253890 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cnibin\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4874c666-a757-4073-b1b2-e5691cded13b-host-slash\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253927 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-kubelet\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-socket-dir-parent\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-kubernetes\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.253973 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4874c666-a757-4073-b1b2-e5691cded13b-host-slash\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-slash\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.254239 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-systemd\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-etc-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254120 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-run-ovn-kubernetes\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-system-cni-dir\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cni-binary-copy\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-systemd\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254195 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-slash\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254215 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-run-ovn-kubernetes\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254218 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-system-cni-dir\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-k8s-cni-cncf-io\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254255 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-socket-dir-parent\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-dbus\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-var-lib-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254305 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-etc-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254298 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovnkube-script-lib\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254367 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-cni-multus\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254391 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-run-k8s-cni-cncf-io\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-device-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254424 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-cni-multus\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-run\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-var-lib-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-ovn\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-hostroot\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-daemon-config\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-etc-selinux\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472ct\" (UniqueName: \"kubernetes.io/projected/14fa85da-6f90-47d6-af03-b866cdf8984f-kube-api-access-472ct\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysctl-d\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254769 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-ovn\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-systemd\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254821 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-hostroot\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254861 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cni-binary-copy\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.255744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-node-log\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-kubelet\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-run-openvswitch\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254986 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovnkube-script-lib\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.254995 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-dbus\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/466c7648-5bab-4ad0-b968-dd746046268c-etc-tuned\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255036 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-kubelet\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255069 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-node-log\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-cni-bin\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4874c666-a757-4073-b1b2-e5691cded13b-iptables-alerter-script\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jj7t\" (UniqueName: \"kubernetes.io/projected/4874c666-a757-4073-b1b2-e5691cded13b-kube-api-access-7jj7t\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255170 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-cni-bin\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-etc-kubernetes\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255207 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-sys\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-etc-kubernetes\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpqb\" (UniqueName: \"kubernetes.io/projected/466c7648-5bab-4ad0-b968-dd746046268c-kube-api-access-zhpqb\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.256578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255271 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caa35324-f4af-4076-92d3-a6f6d67ce265-host\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/caa35324-f4af-4076-92d3-a6f6d67ce265-serviceca\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-daemon-config\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9093d3c7-76d7-4b85-af01-3f89a79078f3-konnectivity-ca\") pod \"konnectivity-agent-5b6wc\" (UID: \"9093d3c7-76d7-4b85-af01-3f89a79078f3\") " pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysctl-conf\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255478 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caa35324-f4af-4076-92d3-a6f6d67ce265-host\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-kubelet-config\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255564 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-kubelet-config\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-env-overrides\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2hl\" (UniqueName: \"kubernetes.io/projected/4a8e699f-0555-404f-ba4b-7b40b3de1f79-kube-api-access-vl2hl\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.255645 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-conf-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255673 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-registration-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.257202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255677 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4874c666-a757-4073-b1b2-e5691cded13b-iptables-alerter-script\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.255725 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:35.755687645 +0000 UTC m=+3.005529745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255736 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-multus-conf-dir\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-lib-modules\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-cni-netd\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovnkube-config\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dct9\" (UniqueName: \"kubernetes.io/projected/2fb6564d-f707-40af-81f9-3aae39c4c705-kube-api-access-7dct9\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-cni-binary-copy\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255891 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-modprobe-d\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-host-cni-netd\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255945 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-systemd-units\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255947 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255948 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/caa35324-f4af-4076-92d3-a6f6d67ce265-serviceca\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9093d3c7-76d7-4b85-af01-3f89a79078f3-agent-certs\") pod \"konnectivity-agent-5b6wc\" (UID: \"9093d3c7-76d7-4b85-af01-3f89a79078f3\") " pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.255994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb6564d-f707-40af-81f9-3aae39c4c705-tmp-dir\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-cni-bin\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.257779 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.256036 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-host\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-env-overrides\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.256079 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:35.756064717 +0000 UTC m=+3.005906818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/466c7648-5bab-4ad0-b968-dd746046268c-tmp\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-host-var-lib-cni-bin\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256131 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b9bb195-ad59-45d7-a6b0-cef42803856e-systemd-units\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256264 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a8e699f-0555-404f-ba4b-7b40b3de1f79-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb6564d-f707-40af-81f9-3aae39c4c705-tmp-dir\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256461 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-cni-binary-copy\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovnkube-config\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.256629 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a8e699f-0555-404f-ba4b-7b40b3de1f79-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.258471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.258052 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b9bb195-ad59-45d7-a6b0-cef42803856e-ovn-node-metrics-cert\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.265171 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.265147 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrrl\" (UniqueName: \"kubernetes.io/projected/caa35324-f4af-4076-92d3-a6f6d67ce265-kube-api-access-vsrrl\") pod \"node-ca-cnz2l\" (UID: \"caa35324-f4af-4076-92d3-a6f6d67ce265\") " pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.266053 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.266031 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rc2f\" (UniqueName: \"kubernetes.io/projected/55062c7a-cad0-49d8-90a0-6e9322eeaef7-kube-api-access-4rc2f\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.266489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.266445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpv4r\" (UniqueName: \"kubernetes.io/projected/4b9bb195-ad59-45d7-a6b0-cef42803856e-kube-api-access-lpv4r\") pod \"ovnkube-node-sr8rp\" (UID: \"4b9bb195-ad59-45d7-a6b0-cef42803856e\") " pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.266815 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.266795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmlsf\" (UniqueName: \"kubernetes.io/projected/a06e1668-4b1f-4531-9b40-7bcab1c52f2a-kube-api-access-bmlsf\") pod \"multus-pml5c\" (UID: \"a06e1668-4b1f-4531-9b40-7bcab1c52f2a\") " pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.267851 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.267820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dct9\" (UniqueName: \"kubernetes.io/projected/2fb6564d-f707-40af-81f9-3aae39c4c705-kube-api-access-7dct9\") pod \"node-resolver-v8jdn\" (UID: \"2fb6564d-f707-40af-81f9-3aae39c4c705\") " pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.270360 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.270341 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:35.270360 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.270362 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:35.270500 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.270373 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:35.270500 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.270445 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:35.770426346 +0000 UTC m=+3.020268460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:35.272452 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.272431 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2hl\" (UniqueName: \"kubernetes.io/projected/4a8e699f-0555-404f-ba4b-7b40b3de1f79-kube-api-access-vl2hl\") pod \"multus-additional-cni-plugins-jtv8h\" (UID: \"4a8e699f-0555-404f-ba4b-7b40b3de1f79\") " pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.272972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.272952 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jj7t\" (UniqueName: \"kubernetes.io/projected/4874c666-a757-4073-b1b2-e5691cded13b-kube-api-access-7jj7t\") pod \"iptables-alerter-dkn2g\" (UID: \"4874c666-a757-4073-b1b2-e5691cded13b\") " pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.356507 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9093d3c7-76d7-4b85-af01-3f89a79078f3-konnectivity-ca\") pod \"konnectivity-agent-5b6wc\" (UID: \"9093d3c7-76d7-4b85-af01-3f89a79078f3\") " pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.356507 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysctl-conf\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356737 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysctl-conf\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356737 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356649 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-registration-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.356737 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-lib-modules\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356737 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-modprobe-d\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9093d3c7-76d7-4b85-af01-3f89a79078f3-agent-certs\") pod \"konnectivity-agent-5b6wc\" (UID: \"9093d3c7-76d7-4b85-af01-3f89a79078f3\") " pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356764 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-registration-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-host\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/466c7648-5bab-4ad0-b968-dd746046268c-tmp\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-lib-modules\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-sys-fs\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-modprobe-d\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysconfig\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-sys-fs\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-socket-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-var-lib-kubelet\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356946 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysconfig\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356893 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-host\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.356968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.356973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-kubernetes\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357020 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-socket-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-device-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-run\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-kubernetes\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-etc-selinux\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-var-lib-kubelet\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472ct\" (UniqueName: \"kubernetes.io/projected/14fa85da-6f90-47d6-af03-b866cdf8984f-kube-api-access-472ct\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-run\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357136 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-device-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysctl-d\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357054 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9093d3c7-76d7-4b85-af01-3f89a79078f3-konnectivity-ca\") pod \"konnectivity-agent-5b6wc\" (UID: \"9093d3c7-76d7-4b85-af01-3f89a79078f3\") " pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-etc-selinux\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-systemd\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357208 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-systemd\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/466c7648-5bab-4ad0-b968-dd746046268c-etc-tuned\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.357545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-etc-sysctl-d\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.358084 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-sys\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.358084 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357278 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14fa85da-6f90-47d6-af03-b866cdf8984f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.358084 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357291 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466c7648-5bab-4ad0-b968-dd746046268c-sys\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.358084 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.357286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpqb\" (UniqueName: \"kubernetes.io/projected/466c7648-5bab-4ad0-b968-dd746046268c-kube-api-access-zhpqb\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.359255 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.359231 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/466c7648-5bab-4ad0-b968-dd746046268c-tmp\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.359581 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.359553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9093d3c7-76d7-4b85-af01-3f89a79078f3-agent-certs\") pod \"konnectivity-agent-5b6wc\" (UID: \"9093d3c7-76d7-4b85-af01-3f89a79078f3\") " pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.359725 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.359705 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/466c7648-5bab-4ad0-b968-dd746046268c-etc-tuned\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.365133 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.365109 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpqb\" (UniqueName: \"kubernetes.io/projected/466c7648-5bab-4ad0-b968-dd746046268c-kube-api-access-zhpqb\") pod \"tuned-vdxst\" (UID: \"466c7648-5bab-4ad0-b968-dd746046268c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.365352 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.365330 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-472ct\" (UniqueName: \"kubernetes.io/projected/14fa85da-6f90-47d6-af03-b866cdf8984f-kube-api-access-472ct\") pod \"aws-ebs-csi-driver-node-pk8zt\" (UID: \"14fa85da-6f90-47d6-af03-b866cdf8984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.392244 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.392162 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:35.445442 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.445407 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dkn2g" Jun 03 23:24:35.452552 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.452525 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v8jdn" Jun 03 23:24:35.461463 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.461441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnz2l" Jun 03 23:24:35.466333 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.466313 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" Jun 03 23:24:35.474959 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.474936 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pml5c" Jun 03 23:24:35.482311 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.482285 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:24:35.489535 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.489512 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:35.497143 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.497123 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" Jun 03 23:24:35.501614 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.501595 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vdxst" Jun 03 23:24:35.760970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.760891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:35.760970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.760943 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:35.761165 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.761050 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:35.761165 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.761061 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:35.761165 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.761110 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:36.761092648 +0000 UTC m=+4.010934746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:35.761165 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.761138 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:36.761118941 +0000 UTC m=+4.010961046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:35.862016 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:35.861980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:35.862190 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.862116 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:35.862190 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.862131 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:35.862190 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.862141 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:35.862317 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:35.862199 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:36.862181686 +0000 UTC m=+4.112023793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:35.949284 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.949252 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8e699f_0555_404f_ba4b_7b40b3de1f79.slice/crio-db7b9f1c5c6c4dd22f67b70590decac695e0f06a5523384346084ebbba4e3a72 WatchSource:0}: Error finding container db7b9f1c5c6c4dd22f67b70590decac695e0f06a5523384346084ebbba4e3a72: Status 404 returned error can't find the container with id db7b9f1c5c6c4dd22f67b70590decac695e0f06a5523384346084ebbba4e3a72 Jun 03 23:24:35.950183 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.950156 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fa85da_6f90_47d6_af03_b866cdf8984f.slice/crio-30f13f46c586dca3fd77b116e6a72801ee16b629dda773800cca217bf9365226 WatchSource:0}: Error finding container 30f13f46c586dca3fd77b116e6a72801ee16b629dda773800cca217bf9365226: Status 404 returned error can't find the container with id 30f13f46c586dca3fd77b116e6a72801ee16b629dda773800cca217bf9365226 Jun 03 23:24:35.951070 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.951047 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9093d3c7_76d7_4b85_af01_3f89a79078f3.slice/crio-4412b7ef4425a54509d88fac73655108baf7daf9af22429a2cf1d8c1c0c65330 WatchSource:0}: Error finding container 4412b7ef4425a54509d88fac73655108baf7daf9af22429a2cf1d8c1c0c65330: Status 404 returned error can't find the container with id 4412b7ef4425a54509d88fac73655108baf7daf9af22429a2cf1d8c1c0c65330 Jun 03 23:24:35.954198 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.954178 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb6564d_f707_40af_81f9_3aae39c4c705.slice/crio-d28c1342ff9079b0214563177b0376a8531ef90bd9494699c8d13d0c284168c2 WatchSource:0}: Error finding container d28c1342ff9079b0214563177b0376a8531ef90bd9494699c8d13d0c284168c2: Status 404 returned error can't find the container with id d28c1342ff9079b0214563177b0376a8531ef90bd9494699c8d13d0c284168c2 Jun 03 23:24:35.955264 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.955246 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466c7648_5bab_4ad0_b968_dd746046268c.slice/crio-0b66f472938d524b84045167f40c1b9e25050b25dd75179221f0ae5965e25946 WatchSource:0}: Error finding container 0b66f472938d524b84045167f40c1b9e25050b25dd75179221f0ae5965e25946: Status 404 returned error can't find the container with id 0b66f472938d524b84045167f40c1b9e25050b25dd75179221f0ae5965e25946 Jun 03 23:24:35.957184 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.957151 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4874c666_a757_4073_b1b2_e5691cded13b.slice/crio-a5897cfc104d29e323acce6c2b3676675d9be19d2d69b88015365459228238aa WatchSource:0}: Error finding container a5897cfc104d29e323acce6c2b3676675d9be19d2d69b88015365459228238aa: Status 404 returned error can't find the container with id a5897cfc104d29e323acce6c2b3676675d9be19d2d69b88015365459228238aa Jun 03 23:24:35.957980 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.957957 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06e1668_4b1f_4531_9b40_7bcab1c52f2a.slice/crio-b3a87a9840a4033c434087a44ac076fb6915d9c91d282cbf876fdf0a1ef6bc0e WatchSource:0}: Error finding container b3a87a9840a4033c434087a44ac076fb6915d9c91d282cbf876fdf0a1ef6bc0e: Status 404 returned error can't find the container with id b3a87a9840a4033c434087a44ac076fb6915d9c91d282cbf876fdf0a1ef6bc0e Jun 03 23:24:35.958918 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.958863 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa35324_f4af_4076_92d3_a6f6d67ce265.slice/crio-035d7418ad81fe2ade8f69af0c9e35cbc57bd8ca8a3544e7fcafbd554b3029a9 WatchSource:0}: Error finding container 035d7418ad81fe2ade8f69af0c9e35cbc57bd8ca8a3544e7fcafbd554b3029a9: Status 404 returned error can't find the container with id 035d7418ad81fe2ade8f69af0c9e35cbc57bd8ca8a3544e7fcafbd554b3029a9 Jun 03 23:24:35.960411 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:24:35.960389 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9bb195_ad59_45d7_a6b0_cef42803856e.slice/crio-6d991236db522e79ebf5962afe2f87d9a79d47442162e344254269bbd1c0eb82 WatchSource:0}: Error finding container 6d991236db522e79ebf5962afe2f87d9a79d47442162e344254269bbd1c0eb82: Status 404 returned error can't find the container with id 6d991236db522e79ebf5962afe2f87d9a79d47442162e344254269bbd1c0eb82 Jun 03 23:24:36.209791 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.209643 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:35 +0000 UTC" deadline="2028-01-19 05:42:36.017469133 +0000 UTC" Jun 03 23:24:36.210094 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.209792 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14262h17m59.807682494s" Jun 03 23:24:36.226950 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.226918 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnz2l" event={"ID":"caa35324-f4af-4076-92d3-a6f6d67ce265","Type":"ContainerStarted","Data":"035d7418ad81fe2ade8f69af0c9e35cbc57bd8ca8a3544e7fcafbd554b3029a9"} Jun 03 23:24:36.227982 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.227955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dkn2g" event={"ID":"4874c666-a757-4073-b1b2-e5691cded13b","Type":"ContainerStarted","Data":"a5897cfc104d29e323acce6c2b3676675d9be19d2d69b88015365459228238aa"} Jun 03 23:24:36.229021 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.228998 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v8jdn" event={"ID":"2fb6564d-f707-40af-81f9-3aae39c4c705","Type":"ContainerStarted","Data":"d28c1342ff9079b0214563177b0376a8531ef90bd9494699c8d13d0c284168c2"} Jun 03 23:24:36.229964 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.229940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5b6wc" event={"ID":"9093d3c7-76d7-4b85-af01-3f89a79078f3","Type":"ContainerStarted","Data":"4412b7ef4425a54509d88fac73655108baf7daf9af22429a2cf1d8c1c0c65330"} Jun 03 23:24:36.230960 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.230940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerStarted","Data":"db7b9f1c5c6c4dd22f67b70590decac695e0f06a5523384346084ebbba4e3a72"} Jun 03 23:24:36.232536 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.232511 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerStarted","Data":"2ee35060fa455c7c41f52956a94d2416d6951e6a929600f135d73df944fdec49"} Jun 03 23:24:36.233644 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.233620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"6d991236db522e79ebf5962afe2f87d9a79d47442162e344254269bbd1c0eb82"} Jun 03 23:24:36.237304 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.234949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pml5c" event={"ID":"a06e1668-4b1f-4531-9b40-7bcab1c52f2a","Type":"ContainerStarted","Data":"b3a87a9840a4033c434087a44ac076fb6915d9c91d282cbf876fdf0a1ef6bc0e"} Jun 03 23:24:36.238623 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.238601 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vdxst" event={"ID":"466c7648-5bab-4ad0-b968-dd746046268c","Type":"ContainerStarted","Data":"0b66f472938d524b84045167f40c1b9e25050b25dd75179221f0ae5965e25946"} Jun 03 23:24:36.243863 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.243823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" event={"ID":"14fa85da-6f90-47d6-af03-b866cdf8984f","Type":"ContainerStarted","Data":"30f13f46c586dca3fd77b116e6a72801ee16b629dda773800cca217bf9365226"} Jun 03 23:24:36.245125 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.245105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" event={"ID":"ec9151502287c53bc92d18ac37228f32","Type":"ContainerStarted","Data":"acffe94a396fba392b6dea443ff543bb6afd45b5f76ecdd78f94d82db0e3cc9d"} Jun 03 23:24:36.265426 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.265374 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" podStartSLOduration=2.265353089 podStartE2EDuration="2.265353089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:36.265058704 +0000 UTC m=+3.514900822" watchObservedRunningTime="2026-06-03 23:24:36.265353089 +0000 UTC m=+3.515195207" Jun 03 23:24:36.769182 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.769146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:36.769371 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.769246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:36.769447 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.769369 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:36.769447 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.769432 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:38.769413962 +0000 UTC m=+6.019256063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:36.769869 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.769827 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:36.769956 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.769940 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:38.769921493 +0000 UTC m=+6.019763632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:36.870419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:36.870378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:36.870611 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.870572 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:36.870611 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.870596 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:36.870611 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.870609 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:36.870761 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:36.870670 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:38.87065117 +0000 UTC m=+6.120493271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:37.210851 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.210753 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:35 +0000 UTC" deadline="2027-11-20 15:55:08.624451171 +0000 UTC" Jun 03 23:24:37.210851 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.210806 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12832h30m31.413648608s" Jun 03 23:24:37.218771 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.218127 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:37.218771 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:37.218249 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:37.218771 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.218627 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:37.218771 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:37.218732 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:37.219311 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.219177 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:37.219311 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:37.219276 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:37.257574 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.257185 2568 generic.go:356] "Generic (PLEG): container finished" podID="d39722b944d26a5edbc396c94a76c862" containerID="2ee35060fa455c7c41f52956a94d2416d6951e6a929600f135d73df944fdec49" exitCode=0 Jun 03 23:24:37.258165 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:37.258139 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerDied","Data":"2ee35060fa455c7c41f52956a94d2416d6951e6a929600f135d73df944fdec49"} Jun 03 23:24:38.287706 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:38.287090 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerStarted","Data":"30fe782f1403c2cf068ebe5d690b34704ec38f5da8494c035dfe6a581014633e"} Jun 03 23:24:38.787916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:38.787868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:38.787916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:38.787924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:38.788163 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.788074 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:38.788163 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.788141 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.788121703 +0000 UTC m=+10.037963805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:38.788678 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.788534 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:38.788678 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.788590 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.788574067 +0000 UTC m=+10.038416184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:38.889471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:38.888833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:38.889471 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.889054 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:38.889471 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.889074 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:38.889471 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.889087 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:38.889471 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:38.889144 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.889127369 +0000 UTC m=+10.138969489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:39.219031 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:39.219003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:39.219170 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:39.219126 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:39.219744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:39.219485 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:39.219744 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:39.219592 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:39.219744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:39.219637 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:39.219744 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:39.219701 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:41.220018 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:41.219979 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:41.220489 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:41.220120 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:41.220550 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:41.220506 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:41.220599 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:41.220582 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:41.220728 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:41.220712 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:41.220814 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:41.220797 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:42.825032 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:42.824993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:42.825661 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:42.825043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:42.825661 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.825164 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:42.825661 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.825254 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:50.825232502 +0000 UTC m=+18.075074602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:42.825661 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.825169 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:42.825661 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.825301 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:50.825289768 +0000 UTC m=+18.075131870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:42.925621 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:42.925575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:42.926231 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.925783 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:42.926231 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.925900 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:42.926231 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.925916 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:42.926231 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:42.925989 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:50.925964985 +0000 UTC m=+18.175807096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:43.219483 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:43.218988 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:43.219483 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:43.219117 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:43.219483 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:43.219206 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:43.219483 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:43.219365 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:43.219483 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:43.219421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:43.219901 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:43.219496 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:45.218554 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:45.218518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:45.219030 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:45.218563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:45.219030 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:45.218661 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:45.219030 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:45.218724 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:45.219030 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:45.218771 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:45.219030 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:45.218835 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:47.219129 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:47.219091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:47.219593 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:47.219091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:47.219593 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:47.219217 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:47.219593 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:47.219311 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:47.219593 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:47.219092 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:47.219593 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:47.219425 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:49.219100 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:49.219063 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:49.219509 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:49.219126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:49.219509 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:49.219144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:49.219509 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:49.219244 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:49.219509 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:49.219382 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:49.219509 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:49.219487 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:50.886065 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:50.886020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:50.886065 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:50.886081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:50.886765 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.886189 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:50.886765 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.886266 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.886245701 +0000 UTC m=+34.136087812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:50.886765 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.886195 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:50.886765 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.886353 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.886335943 +0000 UTC m=+34.136178048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:50.986975 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:50.986936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:50.987170 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.987095 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:50.987170 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.987116 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:50.987170 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.987132 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:50.987331 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:50.987191 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.987174417 +0000 UTC m=+34.237016531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:51.218211 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:51.218122 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:51.218378 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:51.218128 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:51.218378 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:51.218243 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:51.218378 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:51.218365 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:51.218545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:51.218131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:51.218545 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:51.218466 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:53.219122 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:53.219089 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:53.219567 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:53.219192 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:53.219567 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:53.219263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:53.219567 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:53.219360 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:53.219567 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:53.219401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:53.219567 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:53.219466 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:55.219092 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.218677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:55.219653 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.218684 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:55.219653 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:55.219143 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:55.219653 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:55.219243 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:55.219653 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.218717 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:55.219653 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:55.219355 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:55.331258 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.331216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"a3afd609173e75a8f8b3c185f03a858f104f44fa0c442d8082e4de1f455f4c43"} Jun 03 23:24:55.331439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.331292 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"ea5d987dc88b9462bb11907a6f84475269c72a377d654a0fc6a77f9f3035526b"} Jun 03 23:24:55.331439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.331333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"a6a43bb10f6dca4ea6386462a66ab261b58c5adcc0bfada8ee706cfc05ed50b2"} Jun 03 23:24:55.331439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.331361 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"b88abe3ec06c3e9afd8e8bdac7a2c3b331019077b5e65cca5acf0ecfe8280915"} Jun 03 23:24:55.331439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.331387 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"511b16b9807db0d3737b88ead402fca758d6842b5266d8cff8975719bdd7fa3b"} Jun 03 23:24:55.331439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.331421 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"fc611bb0f625e8ce065b563697708fb0e7ef1f6195c044b35478e26e57ffd20c"} Jun 03 23:24:55.332469 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.332447 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pml5c" event={"ID":"a06e1668-4b1f-4531-9b40-7bcab1c52f2a","Type":"ContainerStarted","Data":"10decb2348e4ec849cce21b0b9882a4ba76819d77938ae552970862753aa8537"} Jun 03 23:24:55.333886 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.333865 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vdxst" event={"ID":"466c7648-5bab-4ad0-b968-dd746046268c","Type":"ContainerStarted","Data":"f11e511f0118cc06fd19bbb87306c328d56ea67d7b49f952f18eb0bf93c863df"} Jun 03 23:24:55.335175 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.335155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" event={"ID":"14fa85da-6f90-47d6-af03-b866cdf8984f","Type":"ContainerStarted","Data":"4abc646432fabe095842c25f7f1febf0702eb8701f478f5e11db94e4e24a2424"} Jun 03 23:24:55.336432 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.336412 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnz2l" event={"ID":"caa35324-f4af-4076-92d3-a6f6d67ce265","Type":"ContainerStarted","Data":"4160696fb1a69e6c5d2c1acef8263b3c19a87fa73e961944da4a10d8c45b7c76"} Jun 03 23:24:55.337771 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.337752 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v8jdn" event={"ID":"2fb6564d-f707-40af-81f9-3aae39c4c705","Type":"ContainerStarted","Data":"68063202576fd9e55521011d6a301e3c22ad2a9a4c0ceb00eba6fba288686f50"} Jun 03 23:24:55.339083 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.339061 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5b6wc" event={"ID":"9093d3c7-76d7-4b85-af01-3f89a79078f3","Type":"ContainerStarted","Data":"a539cf42857dcbb443dca951c57a1056373865f3c1cc7b29f727cc9379f8fa67"} Jun 03 23:24:55.340470 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.340450 2568 generic.go:356] "Generic (PLEG): container finished" podID="4a8e699f-0555-404f-ba4b-7b40b3de1f79" containerID="2bd2151b49a56f14a9e38c8040eaa25b1f95ae9b671efe41c68486c7d1bc5cc9" exitCode=0 Jun 03 23:24:55.340562 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.340476 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerDied","Data":"2bd2151b49a56f14a9e38c8040eaa25b1f95ae9b671efe41c68486c7d1bc5cc9"} Jun 03 23:24:55.351271 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.351227 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" podStartSLOduration=21.351214746 podStartE2EDuration="21.351214746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:38.304229145 +0000 UTC m=+5.554071264" watchObservedRunningTime="2026-06-03 23:24:55.351214746 +0000 UTC m=+22.601056863" Jun 03 23:24:55.351430 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.351411 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pml5c" podStartSLOduration=4.109261901 podStartE2EDuration="22.351407779s" totalImagesPullingTime="18.242145878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:55.35134033 +0000 UTC m=+22.601182432" watchObservedRunningTime="2026-06-03 23:24:55.351407779 +0000 UTC m=+22.601249896" Jun 03 23:24:55.367146 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.367105 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v8jdn" podStartSLOduration=4.120023527 podStartE2EDuration="22.367090523s" totalImagesPullingTime="18.247066996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:55.366691322 +0000 UTC m=+22.616533439" watchObservedRunningTime="2026-06-03 23:24:55.367090523 +0000 UTC m=+22.616932641" Jun 03 23:24:55.390732 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.390679 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vdxst" podStartSLOduration=4.144967478 podStartE2EDuration="22.390664185s" totalImagesPullingTime="18.245696707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:55.390445678 +0000 UTC m=+22.640287795" watchObservedRunningTime="2026-06-03 23:24:55.390664185 +0000 UTC m=+22.640506302" Jun 03 23:24:55.405177 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.405131 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cnz2l" podStartSLOduration=4.196137289 podStartE2EDuration="22.405117729s" totalImagesPullingTime="18.20898044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:55.404879949 +0000 UTC m=+22.654722067" watchObservedRunningTime="2026-06-03 23:24:55.405117729 +0000 UTC m=+22.654959847" Jun 03 23:24:55.447626 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.447570 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5b6wc" podStartSLOduration=4.230620973 podStartE2EDuration="22.447555247s" totalImagesPullingTime="18.216934274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:55.447311809 +0000 UTC m=+22.697153926" watchObservedRunningTime="2026-06-03 23:24:55.447555247 +0000 UTC m=+22.697397365" Jun 03 23:24:55.686472 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:55.686426 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 23:24:56.216724 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:56.216599 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T23:24:55.686466315Z","UUID":"b4f4e73b-c303-45ed-803b-30027bb38f50","Handler":null,"Name":"","Endpoint":""} Jun 03 23:24:56.218176 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:56.218154 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 23:24:56.218335 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:56.218197 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 23:24:56.345782 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:56.345746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" event={"ID":"14fa85da-6f90-47d6-af03-b866cdf8984f","Type":"ContainerStarted","Data":"6c13cca60d2d2d03b335fd49b6300ba1a862059508aa892be7e12673091d6eb2"} Jun 03 23:24:56.347830 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:56.347768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dkn2g" event={"ID":"4874c666-a757-4073-b1b2-e5691cded13b","Type":"ContainerStarted","Data":"8fce6036e8c315496ecd755df19bc3798f5bae01a80eba798c8955966b2ca2f2"} Jun 03 23:24:56.363790 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:56.363732 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dkn2g" podStartSLOduration=5.152917371 podStartE2EDuration="23.363714025s" totalImagesPullingTime="18.210796654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:56.363539119 +0000 UTC m=+23.613381238" watchObservedRunningTime="2026-06-03 23:24:56.363714025 +0000 UTC m=+23.613556146" Jun 03 23:24:57.218497 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.218445 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:57.218497 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.218457 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:57.218788 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:57.218568 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:57.218788 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:57.218635 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:57.218788 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.218687 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:57.218788 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:57.218775 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:57.321507 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.321390 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:57.322019 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.322002 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:57.354175 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.354144 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"47ed53ad6d0888285f1fb56ce362c6f84ec63381690846ce5c9233361b9e64c5"} Jun 03 23:24:57.356512 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.356484 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" event={"ID":"14fa85da-6f90-47d6-af03-b866cdf8984f","Type":"ContainerStarted","Data":"48aefc130ff75c5166c90334c69a80d4c3f124752461bb64f17a6f7dfb6761e2"} Jun 03 23:24:57.356821 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.356793 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:57.357425 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.357406 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5b6wc" Jun 03 23:24:57.376804 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:57.376758 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk8zt" podStartSLOduration=3.985727951 podStartE2EDuration="24.376742776s" totalImagesPullingTime="20.391014825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:57.376596177 +0000 UTC m=+24.626438296" watchObservedRunningTime="2026-06-03 23:24:57.376742776 +0000 UTC m=+24.626584894" Jun 03 23:24:59.218417 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:59.218235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:24:59.218795 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:59.218234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:24:59.218795 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:59.218492 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:24:59.218795 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:59.218249 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:24:59.218795 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:59.218594 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:24:59.218795 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:24:59.218638 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:24:59.365929 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:59.364995 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" event={"ID":"4b9bb195-ad59-45d7-a6b0-cef42803856e","Type":"ContainerStarted","Data":"3f1df90b164ef9481eeea21139b2a0ec1b340503e3c532cd98cc15906419f1ef"} Jun 03 23:24:59.400505 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:24:59.400397 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" podStartSLOduration=8.034224925 podStartE2EDuration="26.400380347s" totalImagesPullingTime="18.366155422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:59.399788167 +0000 UTC m=+26.649630285" watchObservedRunningTime="2026-06-03 23:24:59.400380347 +0000 UTC m=+26.650222498" Jun 03 23:25:00.369263 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.369228 2568 generic.go:356] "Generic (PLEG): container finished" podID="4a8e699f-0555-404f-ba4b-7b40b3de1f79" containerID="8228977b8a968afba6b7b0648143fb9b5ae91556986bbe8f559e704210c9eb8c" exitCode=0 Jun 03 23:25:00.369705 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.369310 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerDied","Data":"8228977b8a968afba6b7b0648143fb9b5ae91556986bbe8f559e704210c9eb8c"} Jun 03 23:25:00.369868 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.369822 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:25:00.370001 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.369907 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:25:00.370001 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.369957 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:25:00.385723 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.385698 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:25:00.385876 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:00.385801 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:25:01.218534 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.218294 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:01.218775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.218315 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:01.218775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.218422 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:01.218775 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:01.218693 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:25:01.218775 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:01.218742 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:25:01.218998 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:01.218858 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:25:01.473128 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.473063 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4zng4"] Jun 03 23:25:01.473766 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.473210 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:01.473766 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:01.473296 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:25:01.480019 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.479991 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hm8cg"] Jun 03 23:25:01.480135 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.480112 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:01.480240 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:01.480216 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:25:01.480809 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.480766 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b2x65"] Jun 03 23:25:01.480914 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:01.480902 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:01.481023 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:01.481003 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:25:02.376217 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:02.376185 2568 generic.go:356] "Generic (PLEG): container finished" podID="4a8e699f-0555-404f-ba4b-7b40b3de1f79" containerID="cc97cfe256ede3374d384ed389355870d7bf927beefc8c891abd006e7edd594b" exitCode=0 Jun 03 23:25:02.376377 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:02.376267 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerDied","Data":"cc97cfe256ede3374d384ed389355870d7bf927beefc8c891abd006e7edd594b"} Jun 03 23:25:03.218895 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:03.218866 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:03.219390 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:03.218962 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:25:03.219390 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:03.219003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:03.219390 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:03.219057 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:03.219390 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:03.219106 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:25:03.219390 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:03.219158 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:25:04.383204 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:04.383167 2568 generic.go:356] "Generic (PLEG): container finished" podID="4a8e699f-0555-404f-ba4b-7b40b3de1f79" containerID="4a538d1221f99176577188e30e1b1e0532b9cbddb85118c2dd18427098a191ce" exitCode=0 Jun 03 23:25:04.383764 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:04.383217 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerDied","Data":"4a538d1221f99176577188e30e1b1e0532b9cbddb85118c2dd18427098a191ce"} Jun 03 23:25:05.219358 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:05.219154 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:05.219524 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:05.219168 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:05.219524 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:05.219467 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zng4" podUID="e21b674e-54d2-4be0-aaf1-1da9587f9ca6" Jun 03 23:25:05.219637 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:05.219546 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:25:05.219637 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:05.219222 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:05.219726 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:05.219636 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2x65" podUID="6290fa58-f777-46cd-82a5-8893e3f06ed9" Jun 03 23:25:06.904728 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:06.904686 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:06.904728 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:06.904735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:06.905258 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:06.904854 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:06.905258 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:06.904860 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:06.905258 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:06.904924 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:38.904903095 +0000 UTC m=+66.154745207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:06.905258 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:06.904943 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret podName:e21b674e-54d2-4be0-aaf1-1da9587f9ca6 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:38.904934437 +0000 UTC m=+66.154776536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret") pod "global-pull-secret-syncer-4zng4" (UID: "e21b674e-54d2-4be0-aaf1-1da9587f9ca6") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:07.005178 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.005091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:07.005351 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.005323 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:25:07.005351 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.005347 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:25:07.005459 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.005358 2568 projected.go:196] Error preparing data for projected volume kube-api-access-sx47l for pod openshift-network-diagnostics/network-check-target-b2x65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:07.005459 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.005413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l podName:6290fa58-f777-46cd-82a5-8893e3f06ed9 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:39.005396653 +0000 UTC m=+66.255238750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx47l" (UniqueName: "kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l") pod "network-check-target-b2x65" (UID: "6290fa58-f777-46cd-82a5-8893e3f06ed9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:07.075453 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.075419 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeReady" Jun 03 23:25:07.075633 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.075583 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 23:25:07.138827 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.138790 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jbffp"] Jun 03 23:25:07.141885 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.141862 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghkgz"] Jun 03 23:25:07.142027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.141996 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.144870 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.144650 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 23:25:07.144870 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.144778 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 23:25:07.145059 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.145043 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6h75n\"" Jun 03 23:25:07.145121 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.145080 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.148554 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.148533 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p5tlk\"" Jun 03 23:25:07.149109 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.149085 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 23:25:07.149325 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.149313 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 23:25:07.149669 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.149651 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 23:25:07.156134 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.156102 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jbffp"] Jun 03 23:25:07.168801 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.168771 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghkgz"] Jun 03 23:25:07.222414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.222385 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:07.222589 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.222398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:07.222763 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.222399 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:07.225254 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.225228 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:25:07.225375 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.225231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:25:07.225375 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.225361 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:25:07.225484 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.225463 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mqss\"" Jun 03 23:25:07.225586 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.225568 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9sbx\"" Jun 03 23:25:07.225690 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.225670 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:25:07.307485 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.307402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8z6\" (UniqueName: \"kubernetes.io/projected/67057f66-c324-490b-9e5e-d665b3acc465-kube-api-access-rq8z6\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.307485 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.307443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67057f66-c324-490b-9e5e-d665b3acc465-config-volume\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.307485 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.307464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t54h\" (UniqueName: \"kubernetes.io/projected/22f6e610-93ff-4b38-b514-d29e64371f1f-kube-api-access-2t54h\") pod \"ingress-canary-ghkgz\" (UID: \"22f6e610-93ff-4b38-b514-d29e64371f1f\") " pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.307727 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.307522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67057f66-c324-490b-9e5e-d665b3acc465-tmp-dir\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.307727 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.307609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.307727 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.307647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22f6e610-93ff-4b38-b514-d29e64371f1f-cert\") pod \"ingress-canary-ghkgz\" (UID: \"22f6e610-93ff-4b38-b514-d29e64371f1f\") " pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.408229 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.408192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22f6e610-93ff-4b38-b514-d29e64371f1f-cert\") pod \"ingress-canary-ghkgz\" (UID: \"22f6e610-93ff-4b38-b514-d29e64371f1f\") " pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.408229 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.408241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8z6\" (UniqueName: \"kubernetes.io/projected/67057f66-c324-490b-9e5e-d665b3acc465-kube-api-access-rq8z6\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.408615 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.408583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67057f66-c324-490b-9e5e-d665b3acc465-config-volume\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.408615 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.408613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t54h\" (UniqueName: \"kubernetes.io/projected/22f6e610-93ff-4b38-b514-d29e64371f1f-kube-api-access-2t54h\") pod \"ingress-canary-ghkgz\" (UID: \"22f6e610-93ff-4b38-b514-d29e64371f1f\") " pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.408802 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.408658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67057f66-c324-490b-9e5e-d665b3acc465-tmp-dir\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.408899 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.408822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.408961 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.408949 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:07.409020 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.409006 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:07.908986935 +0000 UTC m=+35.158829032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:07.409147 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.409122 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67057f66-c324-490b-9e5e-d665b3acc465-tmp-dir\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.409282 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.409256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67057f66-c324-490b-9e5e-d665b3acc465-config-volume\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.413597 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.413536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22f6e610-93ff-4b38-b514-d29e64371f1f-cert\") pod \"ingress-canary-ghkgz\" (UID: \"22f6e610-93ff-4b38-b514-d29e64371f1f\") " pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.421487 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.421457 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t54h\" (UniqueName: \"kubernetes.io/projected/22f6e610-93ff-4b38-b514-d29e64371f1f-kube-api-access-2t54h\") pod \"ingress-canary-ghkgz\" (UID: \"22f6e610-93ff-4b38-b514-d29e64371f1f\") " pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.421637 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.421611 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8z6\" (UniqueName: \"kubernetes.io/projected/67057f66-c324-490b-9e5e-d665b3acc465-kube-api-access-rq8z6\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.464416 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.464376 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghkgz" Jun 03 23:25:07.911893 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:07.911852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:07.912381 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.911990 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:07.912381 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:07.912054 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:08.912039608 +0000 UTC m=+36.161881707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:08.369036 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:08.369009 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghkgz"] Jun 03 23:25:08.372046 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:25:08.372022 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f6e610_93ff_4b38_b514_d29e64371f1f.slice/crio-4a341b1535a31303cb7623eba9639a746b7815fbe469bc4591653a63e7d90e27 WatchSource:0}: Error finding container 4a341b1535a31303cb7623eba9639a746b7815fbe469bc4591653a63e7d90e27: Status 404 returned error can't find the container with id 4a341b1535a31303cb7623eba9639a746b7815fbe469bc4591653a63e7d90e27 Jun 03 23:25:08.394190 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:08.394155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghkgz" event={"ID":"22f6e610-93ff-4b38-b514-d29e64371f1f","Type":"ContainerStarted","Data":"4a341b1535a31303cb7623eba9639a746b7815fbe469bc4591653a63e7d90e27"} Jun 03 23:25:08.397436 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:08.397407 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerStarted","Data":"f4b90237a3c1da04f72e8179425cf5b20c398e6f6bc60d79568666cb1422f69f"} Jun 03 23:25:08.920623 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:08.920588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:08.921071 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:08.920719 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:08.921071 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:08.920779 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:10.920761573 +0000 UTC m=+38.170603675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:09.403444 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:09.403406 2568 generic.go:356] "Generic (PLEG): container finished" podID="4a8e699f-0555-404f-ba4b-7b40b3de1f79" containerID="f4b90237a3c1da04f72e8179425cf5b20c398e6f6bc60d79568666cb1422f69f" exitCode=0 Jun 03 23:25:09.403650 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:09.403475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerDied","Data":"f4b90237a3c1da04f72e8179425cf5b20c398e6f6bc60d79568666cb1422f69f"} Jun 03 23:25:10.408748 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:10.408716 2568 generic.go:356] "Generic (PLEG): container finished" podID="4a8e699f-0555-404f-ba4b-7b40b3de1f79" containerID="311685cab291af86aabccd898abb42ce14a3e8ee8df2535dce2c127150bc6414" exitCode=0 Jun 03 23:25:10.409566 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:10.408796 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerDied","Data":"311685cab291af86aabccd898abb42ce14a3e8ee8df2535dce2c127150bc6414"} Jun 03 23:25:10.412458 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:10.412428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghkgz" event={"ID":"22f6e610-93ff-4b38-b514-d29e64371f1f","Type":"ContainerStarted","Data":"d8c523a60e33a4100ff6b97f91a64c5fadeb10b9ab70dae4ce968c341ca7b2bc"} Jun 03 23:25:10.452232 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:10.452167 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghkgz" podStartSLOduration=1.912493892 podStartE2EDuration="3.452144558s" totalImagesPullingTime="1.539650666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:10.451031739 +0000 UTC m=+37.700873869" watchObservedRunningTime="2026-06-03 23:25:10.452144558 +0000 UTC m=+37.701986677" Jun 03 23:25:10.935611 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:10.935577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:10.935784 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:10.935719 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:10.935890 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:10.935787 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:14.935767189 +0000 UTC m=+42.185609300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:11.417883 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:11.417833 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" event={"ID":"4a8e699f-0555-404f-ba4b-7b40b3de1f79","Type":"ContainerStarted","Data":"8b637a6692cabc41ff54c343d426175317ee805c04f9a642d67354e5d9703b5f"} Jun 03 23:25:11.442315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:11.442248 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jtv8h" podStartSLOduration=10.327583847 podStartE2EDuration="38.442230652s" totalImagesPullingTime="28.114646805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:11.441139967 +0000 UTC m=+38.690982102" watchObservedRunningTime="2026-06-03 23:25:11.442230652 +0000 UTC m=+38.692072748" Jun 03 23:25:14.961980 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:14.961765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:14.961980 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:14.961953 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:14.962407 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:14.962041 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:22.962026389 +0000 UTC m=+50.211868488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:23.016911 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.016868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:23.017389 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:23.017008 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:23.017389 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:23.017075 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:39.017059351 +0000 UTC m=+66.266901452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:23.825024 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.824987 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9"] Jun 03 23:25:23.846878 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.846828 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl"] Jun 03 23:25:23.847029 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.846942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:23.849539 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.849511 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 23:25:23.849712 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.849564 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 23:25:23.849712 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.849667 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 23:25:23.849712 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.849697 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 23:25:23.862984 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.862956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9"] Jun 03 23:25:23.863120 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.862994 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl"] Jun 03 23:25:23.863120 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.863092 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:23.865615 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.865596 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 23:25:23.865862 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.865831 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 23:25:23.865966 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.865948 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 23:25:23.866034 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:23.866011 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 23:25:24.022396 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f910dba3-197e-44fd-b6b4-b92511d254f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.022396 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-hub\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d63b520-bbe0-4913-9996-38282e683fd9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq7ds\" (UniqueName: \"kubernetes.io/projected/f910dba3-197e-44fd-b6b4-b92511d254f3-kube-api-access-jq7ds\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-ca\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltzgg\" (UniqueName: \"kubernetes.io/projected/5d63b520-bbe0-4913-9996-38282e683fd9-kube-api-access-ltzgg\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f910dba3-197e-44fd-b6b4-b92511d254f3-tmp\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.022916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.022718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.123438 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d63b520-bbe0-4913-9996-38282e683fd9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.123552 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq7ds\" (UniqueName: \"kubernetes.io/projected/f910dba3-197e-44fd-b6b4-b92511d254f3-kube-api-access-jq7ds\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.123603 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-ca\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.123639 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltzgg\" (UniqueName: \"kubernetes.io/projected/5d63b520-bbe0-4913-9996-38282e683fd9-kube-api-access-ltzgg\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.123722 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f910dba3-197e-44fd-b6b4-b92511d254f3-tmp\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.123757 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.123792 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.123859 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f910dba3-197e-44fd-b6b4-b92511d254f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.123991 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.123891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-hub\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.124152 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.124124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f910dba3-197e-44fd-b6b4-b92511d254f3-tmp\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.124306 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.124285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d63b520-bbe0-4913-9996-38282e683fd9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.127698 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.127666 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-ca\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.127855 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.127817 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.127905 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.127820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-hub\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.127940 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.127910 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d63b520-bbe0-4913-9996-38282e683fd9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.128155 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.128140 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f910dba3-197e-44fd-b6b4-b92511d254f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.136069 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.136038 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltzgg\" (UniqueName: \"kubernetes.io/projected/5d63b520-bbe0-4913-9996-38282e683fd9-kube-api-access-ltzgg\") pod \"cluster-proxy-proxy-agent-75bf599cf9-jc8tl\" (UID: \"5d63b520-bbe0-4913-9996-38282e683fd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.136228 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.136212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq7ds\" (UniqueName: \"kubernetes.io/projected/f910dba3-197e-44fd-b6b4-b92511d254f3-kube-api-access-jq7ds\") pod \"klusterlet-addon-workmgr-795f96747d-jpkt9\" (UID: \"f910dba3-197e-44fd-b6b4-b92511d254f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.157075 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.157039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:24.179234 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.179201 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:25:24.320738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.320707 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9"] Jun 03 23:25:24.323898 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:25:24.323869 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf910dba3_197e_44fd_b6b4_b92511d254f3.slice/crio-0d3d0d1d768858b4d837534175c51d04749a675d0cb44c63c868527373b250ce WatchSource:0}: Error finding container 0d3d0d1d768858b4d837534175c51d04749a675d0cb44c63c868527373b250ce: Status 404 returned error can't find the container with id 0d3d0d1d768858b4d837534175c51d04749a675d0cb44c63c868527373b250ce Jun 03 23:25:24.340625 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.340598 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl"] Jun 03 23:25:24.354123 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:25:24.354087 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d63b520_bbe0_4913_9996_38282e683fd9.slice/crio-bc15886949cce5fbcb898da9f81f4dcb057e59cc67682d5457a7f938092b3593 WatchSource:0}: Error finding container bc15886949cce5fbcb898da9f81f4dcb057e59cc67682d5457a7f938092b3593: Status 404 returned error can't find the container with id bc15886949cce5fbcb898da9f81f4dcb057e59cc67682d5457a7f938092b3593 Jun 03 23:25:24.447454 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.447371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" event={"ID":"5d63b520-bbe0-4913-9996-38282e683fd9","Type":"ContainerStarted","Data":"bc15886949cce5fbcb898da9f81f4dcb057e59cc67682d5457a7f938092b3593"} Jun 03 23:25:24.448455 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:24.448430 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" event={"ID":"f910dba3-197e-44fd-b6b4-b92511d254f3","Type":"ContainerStarted","Data":"0d3d0d1d768858b4d837534175c51d04749a675d0cb44c63c868527373b250ce"} Jun 03 23:25:30.464929 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.464882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" event={"ID":"5d63b520-bbe0-4913-9996-38282e683fd9","Type":"ContainerStarted","Data":"c12909b991ac02943b3ec04df9a2b02c627fc89c2c9d13e7c3443a1dc0fec021"} Jun 03 23:25:30.465394 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.464943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" event={"ID":"5d63b520-bbe0-4913-9996-38282e683fd9","Type":"ContainerStarted","Data":"04c0b76b764425389a802c801e0266ea4cb22eaf11771c997526e055b3e01f27"} Jun 03 23:25:30.465394 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.464958 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" event={"ID":"5d63b520-bbe0-4913-9996-38282e683fd9","Type":"ContainerStarted","Data":"ebafe03c21906073866ec6c2dd8577a11b775f7f51b77207509d6bc120a549f2"} Jun 03 23:25:30.466391 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.466368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" event={"ID":"f910dba3-197e-44fd-b6b4-b92511d254f3","Type":"ContainerStarted","Data":"3758de940f5f0dccc1c5c4665837ca956ee159cfa66bdb2e00026cd3024daec2"} Jun 03 23:25:30.466478 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.466410 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:30.468121 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.468101 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:25:30.486778 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.486732 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" podStartSLOduration=2.320501598 podStartE2EDuration="7.486718122s" totalImagesPullingTime="5.166216524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:30.485747364 +0000 UTC m=+57.735589473" watchObservedRunningTime="2026-06-03 23:25:30.486718122 +0000 UTC m=+57.736560233" Jun 03 23:25:30.504458 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:30.504346 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" podStartSLOduration=2.305520961 podStartE2EDuration="7.50432821s" totalImagesPullingTime="5.198807249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:30.504198983 +0000 UTC m=+57.754041104" watchObservedRunningTime="2026-06-03 23:25:30.50432821 +0000 UTC m=+57.754170331" Jun 03 23:25:32.391359 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:32.391322 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sr8rp" Jun 03 23:25:38.936681 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:38.936636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:25:38.937166 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:38.936717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:38.939797 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:38.939774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:25:38.939870 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:38.939784 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:25:38.946912 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:38.946889 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 23:25:38.947004 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:38.946992 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:42.946971378 +0000 UTC m=+130.196813474 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : secret "metrics-daemon-secret" not found Jun 03 23:25:38.949158 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:38.949132 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e21b674e-54d2-4be0-aaf1-1da9587f9ca6-original-pull-secret\") pod \"global-pull-secret-syncer-4zng4\" (UID: \"e21b674e-54d2-4be0-aaf1-1da9587f9ca6\") " pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:39.038880 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.038824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:39.039045 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.038912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:25:39.039045 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:39.039015 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:39.039129 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:25:39.039079 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:11.039059287 +0000 UTC m=+98.288901383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:25:39.041536 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.041517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zng4" Jun 03 23:25:39.041866 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.041834 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:25:39.052106 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.052085 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:25:39.063201 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.063177 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx47l\" (UniqueName: \"kubernetes.io/projected/6290fa58-f777-46cd-82a5-8893e3f06ed9-kube-api-access-sx47l\") pod \"network-check-target-b2x65\" (UID: \"6290fa58-f777-46cd-82a5-8893e3f06ed9\") " pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:39.188628 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.188534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4zng4"] Jun 03 23:25:39.336480 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.336452 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9sbx\"" Jun 03 23:25:39.344059 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.344037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:39.488730 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.488697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4zng4" event={"ID":"e21b674e-54d2-4be0-aaf1-1da9587f9ca6","Type":"ContainerStarted","Data":"a0290d811c56918e38911f624eacf0fb39837cb4cbf0c073e954172db23c76cf"} Jun 03 23:25:39.497919 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:39.497882 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b2x65"] Jun 03 23:25:39.501170 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:25:39.501144 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6290fa58_f777_46cd_82a5_8893e3f06ed9.slice/crio-8023272b273ae6d5cf163b0504144c271a56a5d8b2b65d105d0179b405b5cb46 WatchSource:0}: Error finding container 8023272b273ae6d5cf163b0504144c271a56a5d8b2b65d105d0179b405b5cb46: Status 404 returned error can't find the container with id 8023272b273ae6d5cf163b0504144c271a56a5d8b2b65d105d0179b405b5cb46 Jun 03 23:25:40.492994 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:40.492954 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b2x65" event={"ID":"6290fa58-f777-46cd-82a5-8893e3f06ed9","Type":"ContainerStarted","Data":"8023272b273ae6d5cf163b0504144c271a56a5d8b2b65d105d0179b405b5cb46"} Jun 03 23:25:44.507400 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:44.507361 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4zng4" event={"ID":"e21b674e-54d2-4be0-aaf1-1da9587f9ca6","Type":"ContainerStarted","Data":"7530812797d82a12699bc1494c029008e2204196371f76838ab6da4f17352d88"} Jun 03 23:25:44.508936 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:44.508913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b2x65" event={"ID":"6290fa58-f777-46cd-82a5-8893e3f06ed9","Type":"ContainerStarted","Data":"39a03b55b19a1acaee64ddcb5a1a93113c756616f9cf686bc6daf5713eb3a0c1"} Jun 03 23:25:44.509071 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:44.509040 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:25:44.523230 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:44.523180 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4zng4" podStartSLOduration=66.94647434 podStartE2EDuration="1m11.523165989s" totalImagesPullingTime="4.576691649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:44.522742751 +0000 UTC m=+71.772584869" watchObservedRunningTime="2026-06-03 23:25:44.523165989 +0000 UTC m=+71.773008106" Jun 03 23:25:44.546214 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:25:44.546159 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b2x65" podStartSLOduration=67.282218409 podStartE2EDuration="1m11.546140448s" totalImagesPullingTime="4.263922039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:44.54577739 +0000 UTC m=+71.795619512" watchObservedRunningTime="2026-06-03 23:25:44.546140448 +0000 UTC m=+71.795982565" Jun 03 23:26:11.064368 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:26:11.064331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:26:11.064781 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:26:11.064457 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:26:11.064781 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:26:11.064519 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:27:15.064506228 +0000 UTC m=+162.314348324 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:26:15.514804 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:26:15.514770 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b2x65" Jun 03 23:26:42.980279 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:26:42.980224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:26:42.980801 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:26:42.980356 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 23:26:42.980801 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:26:42.980430 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs podName:55062c7a-cad0-49d8-90a0-6e9322eeaef7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:44.980407129 +0000 UTC m=+252.230249224 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs") pod "network-metrics-daemon-hm8cg" (UID: "55062c7a-cad0-49d8-90a0-6e9322eeaef7") : secret "metrics-daemon-secret" not found Jun 03 23:27:10.158055 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:27:10.158002 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jbffp" podUID="67057f66-c324-490b-9e5e-d665b3acc465" Jun 03 23:27:10.247621 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:27:10.247576 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hm8cg" podUID="55062c7a-cad0-49d8-90a0-6e9322eeaef7" Jun 03 23:27:10.757154 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:10.757126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbffp" Jun 03 23:27:15.106755 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:15.106695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:27:15.107224 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:27:15.106868 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:27:15.107224 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:27:15.106938 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls podName:67057f66-c324-490b-9e5e-d665b3acc465 nodeName:}" failed. No retries permitted until 2026-06-03 23:29:17.106919702 +0000 UTC m=+284.356761801 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls") pod "dns-default-jbffp" (UID: "67057f66-c324-490b-9e5e-d665b3acc465") : secret "dns-default-metrics-tls" not found Jun 03 23:27:25.218783 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:25.218695 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:27:29.811615 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:29.811580 2568 generic.go:356] "Generic (PLEG): container finished" podID="f910dba3-197e-44fd-b6b4-b92511d254f3" containerID="3758de940f5f0dccc1c5c4665837ca956ee159cfa66bdb2e00026cd3024daec2" exitCode=1 Jun 03 23:27:29.811615 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:29.811627 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" event={"ID":"f910dba3-197e-44fd-b6b4-b92511d254f3","Type":"ContainerDied","Data":"3758de940f5f0dccc1c5c4665837ca956ee159cfa66bdb2e00026cd3024daec2"} Jun 03 23:27:29.812041 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:29.811932 2568 scope.go:117] "RemoveContainer" containerID="3758de940f5f0dccc1c5c4665837ca956ee159cfa66bdb2e00026cd3024daec2" Jun 03 23:27:30.467067 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:30.467028 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:27:30.815827 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:30.815742 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" event={"ID":"f910dba3-197e-44fd-b6b4-b92511d254f3","Type":"ContainerStarted","Data":"d2792e972f07d070c4d6cbffe0156d4981bd5136ed55db3fd5f4bac0e9d40772"} Jun 03 23:27:30.816224 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:30.816005 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:27:30.816509 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:27:30.816492 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795f96747d-jpkt9" Jun 03 23:28:21.948338 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:21.948312 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v8jdn_2fb6564d-f707-40af-81f9-3aae39c4c705/dns-node-resolver/0.log" Jun 03 23:28:22.747998 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:22.747975 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnz2l_caa35324-f4af-4076-92d3-a6f6d67ce265/node-ca/0.log" Jun 03 23:28:23.547914 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:23.547883 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghkgz_22f6e610-93ff-4b38-b514-d29e64371f1f/serve-healthcheck-canary/0.log" Jun 03 23:28:44.998014 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:44.997979 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xr64j"] Jun 03 23:28:45.000349 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.000328 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.003977 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.003954 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h745f\"" Jun 03 23:28:45.004164 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.004150 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 23:28:45.004238 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.004180 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 23:28:45.004238 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.004226 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 23:28:45.005553 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.005535 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 23:28:45.017198 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.017174 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xr64j"] Jun 03 23:28:45.048950 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.048919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:28:45.051250 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.051214 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55062c7a-cad0-49d8-90a0-6e9322eeaef7-metrics-certs\") pod \"network-metrics-daemon-hm8cg\" (UID: \"55062c7a-cad0-49d8-90a0-6e9322eeaef7\") " pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:28:45.067484 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.067457 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-674b5cfd45-cp8kx"] Jun 03 23:28:45.069354 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.069339 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.074921 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.074891 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 23:28:45.075059 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.074921 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 23:28:45.075059 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.074923 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 23:28:45.075059 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.074924 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4x8v9\"" Jun 03 23:28:45.094156 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.094131 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 23:28:45.098415 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.098393 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674b5cfd45-cp8kx"] Jun 03 23:28:45.149557 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.149517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6kwb\" (UniqueName: \"kubernetes.io/projected/83a86d50-cfbd-40e2-a185-e559dd5428fe-kube-api-access-f6kwb\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.149733 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.149571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83a86d50-cfbd-40e2-a185-e559dd5428fe-data-volume\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.149733 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.149594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83a86d50-cfbd-40e2-a185-e559dd5428fe-crio-socket\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.149733 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.149618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83a86d50-cfbd-40e2-a185-e559dd5428fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.149733 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.149639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83a86d50-cfbd-40e2-a185-e559dd5428fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.250985 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.250891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83a86d50-cfbd-40e2-a185-e559dd5428fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.250985 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.250937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-bound-sa-token\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.250985 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.250980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6kwb\" (UniqueName: \"kubernetes.io/projected/83a86d50-cfbd-40e2-a185-e559dd5428fe-kube-api-access-f6kwb\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.251208 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e16764c7-056e-4832-a33c-f0a1137433ff-trusted-ca\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251208 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83a86d50-cfbd-40e2-a185-e559dd5428fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.251208 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-registry-tls\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251208 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e16764c7-056e-4832-a33c-f0a1137433ff-installation-pull-secrets\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251341 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dmn5\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-kube-api-access-9dmn5\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251341 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251279 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83a86d50-cfbd-40e2-a185-e559dd5428fe-data-volume\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.251421 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e16764c7-056e-4832-a33c-f0a1137433ff-ca-trust-extracted\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251421 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e16764c7-056e-4832-a33c-f0a1137433ff-registry-certificates\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251528 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83a86d50-cfbd-40e2-a185-e559dd5428fe-crio-socket\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.251579 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e16764c7-056e-4832-a33c-f0a1137433ff-image-registry-private-configuration\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.251625 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251584 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83a86d50-cfbd-40e2-a185-e559dd5428fe-crio-socket\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.251625 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251586 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83a86d50-cfbd-40e2-a185-e559dd5428fe-data-volume\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.251688 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.251623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83a86d50-cfbd-40e2-a185-e559dd5428fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.253353 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.253335 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83a86d50-cfbd-40e2-a185-e559dd5428fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.259819 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.259795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6kwb\" (UniqueName: \"kubernetes.io/projected/83a86d50-cfbd-40e2-a185-e559dd5428fe-kube-api-access-f6kwb\") pod \"insights-runtime-extractor-xr64j\" (UID: \"83a86d50-cfbd-40e2-a185-e559dd5428fe\") " pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.308946 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.308915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xr64j" Jun 03 23:28:45.321999 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.321975 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mqss\"" Jun 03 23:28:45.330087 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.330064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hm8cg" Jun 03 23:28:45.352649 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e16764c7-056e-4832-a33c-f0a1137433ff-image-registry-private-configuration\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.352799 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-bound-sa-token\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.352799 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e16764c7-056e-4832-a33c-f0a1137433ff-trusted-ca\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.352918 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-registry-tls\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.352918 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e16764c7-056e-4832-a33c-f0a1137433ff-installation-pull-secrets\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.352918 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352882 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmn5\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-kube-api-access-9dmn5\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.353060 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e16764c7-056e-4832-a33c-f0a1137433ff-ca-trust-extracted\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.353060 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.352966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e16764c7-056e-4832-a33c-f0a1137433ff-registry-certificates\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.353463 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.353432 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e16764c7-056e-4832-a33c-f0a1137433ff-ca-trust-extracted\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.353942 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.353920 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e16764c7-056e-4832-a33c-f0a1137433ff-registry-certificates\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.354307 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.354284 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e16764c7-056e-4832-a33c-f0a1137433ff-trusted-ca\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.355584 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.355551 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e16764c7-056e-4832-a33c-f0a1137433ff-image-registry-private-configuration\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.355913 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.355886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e16764c7-056e-4832-a33c-f0a1137433ff-installation-pull-secrets\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.356353 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.356305 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-registry-tls\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.362676 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.362653 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dmn5\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-kube-api-access-9dmn5\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.369615 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.369585 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e16764c7-056e-4832-a33c-f0a1137433ff-bound-sa-token\") pod \"image-registry-674b5cfd45-cp8kx\" (UID: \"e16764c7-056e-4832-a33c-f0a1137433ff\") " pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.378286 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.378239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:45.455696 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.455621 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xr64j"] Jun 03 23:28:45.459477 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:28:45.459452 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a86d50_cfbd_40e2_a185_e559dd5428fe.slice/crio-fae0f4b5510a32bcef892e2ad25009780e6f454bd16b67aac74eff0e2a567e18 WatchSource:0}: Error finding container fae0f4b5510a32bcef892e2ad25009780e6f454bd16b67aac74eff0e2a567e18: Status 404 returned error can't find the container with id fae0f4b5510a32bcef892e2ad25009780e6f454bd16b67aac74eff0e2a567e18 Jun 03 23:28:45.484006 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.483980 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hm8cg"] Jun 03 23:28:45.490017 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:28:45.489987 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55062c7a_cad0_49d8_90a0_6e9322eeaef7.slice/crio-dc8160079ab5b5cd2330d7bf3e1b00ef48c7fecb40bf4815597e388274a14cec WatchSource:0}: Error finding container dc8160079ab5b5cd2330d7bf3e1b00ef48c7fecb40bf4815597e388274a14cec: Status 404 returned error can't find the container with id dc8160079ab5b5cd2330d7bf3e1b00ef48c7fecb40bf4815597e388274a14cec Jun 03 23:28:45.532621 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:45.532578 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674b5cfd45-cp8kx"] Jun 03 23:28:45.535148 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:28:45.535094 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16764c7_056e_4832_a33c_f0a1137433ff.slice/crio-93cfd7a25f274282378201fc5618592fd4eb4ab636ce03fbe1ec3ef4f2894f1c WatchSource:0}: Error finding container 93cfd7a25f274282378201fc5618592fd4eb4ab636ce03fbe1ec3ef4f2894f1c: Status 404 returned error can't find the container with id 93cfd7a25f274282378201fc5618592fd4eb4ab636ce03fbe1ec3ef4f2894f1c Jun 03 23:28:46.026686 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.026644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" event={"ID":"e16764c7-056e-4832-a33c-f0a1137433ff","Type":"ContainerStarted","Data":"9f9b24a74e9d8a5cc84849ada38056a3cc99d0700745021c4a0704d0bfd94480"} Jun 03 23:28:46.027174 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.026705 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" event={"ID":"e16764c7-056e-4832-a33c-f0a1137433ff","Type":"ContainerStarted","Data":"93cfd7a25f274282378201fc5618592fd4eb4ab636ce03fbe1ec3ef4f2894f1c"} Jun 03 23:28:46.027174 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.026731 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:28:46.028089 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.028059 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hm8cg" event={"ID":"55062c7a-cad0-49d8-90a0-6e9322eeaef7","Type":"ContainerStarted","Data":"dc8160079ab5b5cd2330d7bf3e1b00ef48c7fecb40bf4815597e388274a14cec"} Jun 03 23:28:46.030011 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.029943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr64j" event={"ID":"83a86d50-cfbd-40e2-a185-e559dd5428fe","Type":"ContainerStarted","Data":"f775218e58b1ce651ace9891e5cc29a01e3ae679191ca1823c67595f3d75900b"} Jun 03 23:28:46.030011 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.029998 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr64j" event={"ID":"83a86d50-cfbd-40e2-a185-e559dd5428fe","Type":"ContainerStarted","Data":"fae0f4b5510a32bcef892e2ad25009780e6f454bd16b67aac74eff0e2a567e18"} Jun 03 23:28:46.048916 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:46.048824 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" podStartSLOduration=1.048800436 podStartE2EDuration="1.048800436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:46.048124232 +0000 UTC m=+253.297966350" watchObservedRunningTime="2026-06-03 23:28:46.048800436 +0000 UTC m=+253.298642555" Jun 03 23:28:47.036243 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:47.036207 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hm8cg" event={"ID":"55062c7a-cad0-49d8-90a0-6e9322eeaef7","Type":"ContainerStarted","Data":"e208aaf79f8b1a3258c9eaf898392d85bfa7c5a53fee42b8773ad74ce2242577"} Jun 03 23:28:47.036726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:47.036274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hm8cg" event={"ID":"55062c7a-cad0-49d8-90a0-6e9322eeaef7","Type":"ContainerStarted","Data":"bdac594e81f7ab017d57daf400108c9b2244e1cdb128ef84d15a6ba8cf1600af"} Jun 03 23:28:47.038227 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:47.038191 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr64j" event={"ID":"83a86d50-cfbd-40e2-a185-e559dd5428fe","Type":"ContainerStarted","Data":"e673fdd6c6eb494e0f4e2e89be1a7f3f4156a0595cf91cfa3ad7aab3b02d8c32"} Jun 03 23:28:47.057976 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:47.057916 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hm8cg" podStartSLOduration=253.043129458 podStartE2EDuration="4m14.057893601s" totalImagesPullingTime="1.014764143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:47.056928628 +0000 UTC m=+254.306770747" watchObservedRunningTime="2026-06-03 23:28:47.057893601 +0000 UTC m=+254.307735719" Jun 03 23:28:48.043098 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:48.042995 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr64j" event={"ID":"83a86d50-cfbd-40e2-a185-e559dd5428fe","Type":"ContainerStarted","Data":"3ccc5d5ea0cdd35bdcffb24a572c95acd61e41bfcf632edf9a946968b21c5569"} Jun 03 23:28:48.063111 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:48.063062 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xr64j" podStartSLOduration=1.939047746 podStartE2EDuration="4.063046684s" totalImagesPullingTime="2.123998938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:28:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:48.061486675 +0000 UTC m=+255.311328793" watchObservedRunningTime="2026-06-03 23:28:48.063046684 +0000 UTC m=+255.312888799" Jun 03 23:28:58.144756 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.144672 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nd7z5"] Jun 03 23:28:58.146683 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.146668 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.149631 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.149606 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 23:28:58.149895 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.149872 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 23:28:58.149983 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.149872 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5kp99\"" Jun 03 23:28:58.150724 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.150707 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 23:28:58.150813 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.150721 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 23:28:58.150813 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.150763 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 23:28:58.150949 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.150816 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 23:28:58.245793 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782aa7ce-d702-4e3a-8145-56f18230c8dd-metrics-client-ca\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-root\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6ft\" (UniqueName: \"kubernetes.io/projected/782aa7ce-d702-4e3a-8145-56f18230c8dd-kube-api-access-kf6ft\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-tls\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245891 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-textfile\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-wtmp\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246004 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.245947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-sys\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.246237 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.246030 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346366 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-tls\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346366 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-textfile\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346554 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346554 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-wtmp\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346554 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-sys\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346554 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782aa7ce-d702-4e3a-8145-56f18230c8dd-metrics-client-ca\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346614 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-root\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-sys\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6ft\" (UniqueName: \"kubernetes.io/projected/782aa7ce-d702-4e3a-8145-56f18230c8dd-kube-api-access-kf6ft\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346646 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-wtmp\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.346738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346681 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/782aa7ce-d702-4e3a-8145-56f18230c8dd-root\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.347047 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.346787 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-textfile\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.347203 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.347186 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782aa7ce-d702-4e3a-8145-56f18230c8dd-metrics-client-ca\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.347256 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.347221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.348800 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.348778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-tls\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.348911 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.348830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/782aa7ce-d702-4e3a-8145-56f18230c8dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.356168 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.356145 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6ft\" (UniqueName: \"kubernetes.io/projected/782aa7ce-d702-4e3a-8145-56f18230c8dd-kube-api-access-kf6ft\") pod \"node-exporter-nd7z5\" (UID: \"782aa7ce-d702-4e3a-8145-56f18230c8dd\") " pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.455507 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:58.455425 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nd7z5" Jun 03 23:28:58.465058 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:28:58.465026 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782aa7ce_d702_4e3a_8145_56f18230c8dd.slice/crio-9885d2eb2254af12a837eedff55483987090f93ab6436fd059c39c011b8e384e WatchSource:0}: Error finding container 9885d2eb2254af12a837eedff55483987090f93ab6436fd059c39c011b8e384e: Status 404 returned error can't find the container with id 9885d2eb2254af12a837eedff55483987090f93ab6436fd059c39c011b8e384e Jun 03 23:28:59.079253 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:28:59.079206 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd7z5" event={"ID":"782aa7ce-d702-4e3a-8145-56f18230c8dd","Type":"ContainerStarted","Data":"9885d2eb2254af12a837eedff55483987090f93ab6436fd059c39c011b8e384e"} Jun 03 23:29:00.083471 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:00.083425 2568 generic.go:356] "Generic (PLEG): container finished" podID="782aa7ce-d702-4e3a-8145-56f18230c8dd" containerID="3d3f6608328158bd43ea3032776385d4cddff2b4d77fc1f37710012dbcdd4c26" exitCode=0 Jun 03 23:29:00.083853 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:00.083504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd7z5" event={"ID":"782aa7ce-d702-4e3a-8145-56f18230c8dd","Type":"ContainerDied","Data":"3d3f6608328158bd43ea3032776385d4cddff2b4d77fc1f37710012dbcdd4c26"} Jun 03 23:29:01.089377 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:01.089343 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd7z5" event={"ID":"782aa7ce-d702-4e3a-8145-56f18230c8dd","Type":"ContainerStarted","Data":"3ea30f530b508bef788aec5e621c5218671717a75839b9ef39183f22968584cc"} Jun 03 23:29:01.089804 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:01.089402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd7z5" event={"ID":"782aa7ce-d702-4e3a-8145-56f18230c8dd","Type":"ContainerStarted","Data":"cb005b6ee429d0b60feb3501a6feeda2f16cc8f6ebfa2b06a391c094141a1102"} Jun 03 23:29:01.109903 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:01.109827 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nd7z5" podStartSLOduration=2.232559393 podStartE2EDuration="3.109810852s" totalImagesPullingTime="813.78117ms" totalInitContainerRuntime="63.470289ms" isStatefulPod=true podCreationTimestamp="2026-06-03 23:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:01.108487639 +0000 UTC m=+268.358329758" watchObservedRunningTime="2026-06-03 23:29:01.109810852 +0000 UTC m=+268.359652969" Jun 03 23:29:02.628623 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.628575 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7987c88868-g4t2k"] Jun 03 23:29:02.630597 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.630582 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.634278 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.634257 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kgwjg\"" Jun 03 23:29:02.634593 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.634569 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 23:29:02.634720 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.634632 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 23:29:02.634720 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.634632 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 23:29:02.634720 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.634701 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-47flop7b4gvum\"" Jun 03 23:29:02.634720 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.634711 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 23:29:02.641398 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.641377 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7987c88868-g4t2k"] Jun 03 23:29:02.675926 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.675889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2460577-16ed-492a-afe9-11ed389d4b16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.675926 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.675925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-client-ca-bundle\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.676131 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.675973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-secret-metrics-server-client-certs\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.676131 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.676001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwc7x\" (UniqueName: \"kubernetes.io/projected/e2460577-16ed-492a-afe9-11ed389d4b16-kube-api-access-kwc7x\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.676131 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.676033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e2460577-16ed-492a-afe9-11ed389d4b16-audit-log\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.676131 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.676067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-secret-metrics-server-tls\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.676131 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.676081 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e2460577-16ed-492a-afe9-11ed389d4b16-metrics-server-audit-profiles\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777257 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2460577-16ed-492a-afe9-11ed389d4b16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777295 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-client-ca-bundle\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777502 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-secret-metrics-server-client-certs\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777502 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwc7x\" (UniqueName: \"kubernetes.io/projected/e2460577-16ed-492a-afe9-11ed389d4b16-kube-api-access-kwc7x\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777502 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e2460577-16ed-492a-afe9-11ed389d4b16-audit-log\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777632 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-secret-metrics-server-tls\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777632 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e2460577-16ed-492a-afe9-11ed389d4b16-metrics-server-audit-profiles\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.777948 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.777913 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e2460577-16ed-492a-afe9-11ed389d4b16-audit-log\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.778129 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.778103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2460577-16ed-492a-afe9-11ed389d4b16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.778573 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.778548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e2460577-16ed-492a-afe9-11ed389d4b16-metrics-server-audit-profiles\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.779957 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.779937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-secret-metrics-server-tls\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.780048 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.780004 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-client-ca-bundle\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.780171 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.780152 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e2460577-16ed-492a-afe9-11ed389d4b16-secret-metrics-server-client-certs\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.787201 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.787177 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwc7x\" (UniqueName: \"kubernetes.io/projected/e2460577-16ed-492a-afe9-11ed389d4b16-kube-api-access-kwc7x\") pod \"metrics-server-7987c88868-g4t2k\" (UID: \"e2460577-16ed-492a-afe9-11ed389d4b16\") " pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:02.939069 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:02.938968 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:03.081112 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:03.081087 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7987c88868-g4t2k"] Jun 03 23:29:03.082630 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:29:03.082604 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2460577_16ed_492a_afe9_11ed389d4b16.slice/crio-c2cc18a076e5db09f1c2b174f1d4d2d3a97730c9a9ca291b157d78080ec76aad WatchSource:0}: Error finding container c2cc18a076e5db09f1c2b174f1d4d2d3a97730c9a9ca291b157d78080ec76aad: Status 404 returned error can't find the container with id c2cc18a076e5db09f1c2b174f1d4d2d3a97730c9a9ca291b157d78080ec76aad Jun 03 23:29:03.096541 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:03.096474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" event={"ID":"e2460577-16ed-492a-afe9-11ed389d4b16","Type":"ContainerStarted","Data":"c2cc18a076e5db09f1c2b174f1d4d2d3a97730c9a9ca291b157d78080ec76aad"} Jun 03 23:29:05.105597 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:05.105560 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" event={"ID":"e2460577-16ed-492a-afe9-11ed389d4b16","Type":"ContainerStarted","Data":"5ad5cd0484bc857aeb94a2f9df729fb785d7d027c295ca96cc6282f06a2fb1f2"} Jun 03 23:29:05.125342 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:05.125285 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" podStartSLOduration=1.801748613 podStartE2EDuration="3.125269253s" totalImagesPullingTime="1.32352064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:05.12448834 +0000 UTC m=+272.374330455" watchObservedRunningTime="2026-06-03 23:29:05.125269253 +0000 UTC m=+272.375111371" Jun 03 23:29:05.383292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:05.383194 2568 patch_prober.go:28] interesting pod/image-registry-674b5cfd45-cp8kx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 23:29:05.383292 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:05.383271 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" podUID="e16764c7-056e-4832-a33c-f0a1137433ff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:29:07.043016 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:07.042988 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-674b5cfd45-cp8kx" Jun 03 23:29:13.757658 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:29:13.757602 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jbffp" podUID="67057f66-c324-490b-9e5e-d665b3acc465" Jun 03 23:29:14.131917 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:14.131895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbffp" Jun 03 23:29:17.180719 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:17.180678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:29:17.183028 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:17.183008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67057f66-c324-490b-9e5e-d665b3acc465-metrics-tls\") pod \"dns-default-jbffp\" (UID: \"67057f66-c324-490b-9e5e-d665b3acc465\") " pod="openshift-dns/dns-default-jbffp" Jun 03 23:29:17.435563 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:17.435471 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6h75n\"" Jun 03 23:29:17.443544 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:17.443518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbffp" Jun 03 23:29:17.574736 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:17.574705 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jbffp"] Jun 03 23:29:17.578166 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:29:17.578135 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67057f66_c324_490b_9e5e_d665b3acc465.slice/crio-bb3487ac97b16c8b0d642d069d81d23ed5e99109cd9ebdf9cdfc783ae81e5f85 WatchSource:0}: Error finding container bb3487ac97b16c8b0d642d069d81d23ed5e99109cd9ebdf9cdfc783ae81e5f85: Status 404 returned error can't find the container with id bb3487ac97b16c8b0d642d069d81d23ed5e99109cd9ebdf9cdfc783ae81e5f85 Jun 03 23:29:18.145688 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:18.145653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jbffp" event={"ID":"67057f66-c324-490b-9e5e-d665b3acc465","Type":"ContainerStarted","Data":"bb3487ac97b16c8b0d642d069d81d23ed5e99109cd9ebdf9cdfc783ae81e5f85"} Jun 03 23:29:19.152322 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:19.152287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jbffp" event={"ID":"67057f66-c324-490b-9e5e-d665b3acc465","Type":"ContainerStarted","Data":"d2ef48bcd468a80c46578ff91fe662d281f2b96782115fb65c09fe624b69af7b"} Jun 03 23:29:19.152758 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:19.152342 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jbffp" event={"ID":"67057f66-c324-490b-9e5e-d665b3acc465","Type":"ContainerStarted","Data":"4854bea58d498225ac01d34b14241783d2d68e4ceca795d063d70f7c462ddf51"} Jun 03 23:29:19.152758 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:19.152426 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jbffp" Jun 03 23:29:22.939209 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:22.939152 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:22.939609 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:22.939232 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:25.628950 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:25.628922 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jbffp_67057f66-c324-490b-9e5e-d665b3acc465/dns/0.log" Jun 03 23:29:25.825981 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:25.825913 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jbffp_67057f66-c324-490b-9e5e-d665b3acc465/kube-rbac-proxy/0.log" Jun 03 23:29:26.825315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:26.825286 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v8jdn_2fb6564d-f707-40af-81f9-3aae39c4c705/dns-node-resolver/0.log" Jun 03 23:29:27.424965 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:27.424923 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghkgz_22f6e610-93ff-4b38-b514-d29e64371f1f/serve-healthcheck-canary/0.log" Jun 03 23:29:29.158919 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:29.158887 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jbffp" Jun 03 23:29:29.177553 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:29.177503 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jbffp" podStartSLOduration=260.849979974 podStartE2EDuration="4m22.177489248s" totalImagesPullingTime="1.327509274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:19.19288034 +0000 UTC m=+286.442722458" watchObservedRunningTime="2026-06-03 23:29:29.177489248 +0000 UTC m=+296.427331362" Jun 03 23:29:33.164926 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:33.164900 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 23:29:42.944496 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:42.944459 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:42.949980 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:42.948320 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7987c88868-g4t2k" Jun 03 23:29:44.181002 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:44.180968 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" podUID="5d63b520-bbe0-4913-9996-38282e683fd9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 23:29:54.181006 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:29:54.180966 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" podUID="5d63b520-bbe0-4913-9996-38282e683fd9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 23:30:04.180590 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:04.180551 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" podUID="5d63b520-bbe0-4913-9996-38282e683fd9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 23:30:04.180992 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:04.180625 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" Jun 03 23:30:04.181116 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:04.181086 2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c12909b991ac02943b3ec04df9a2b02c627fc89c2c9d13e7c3443a1dc0fec021"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 23:30:04.181154 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:04.181136 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" podUID="5d63b520-bbe0-4913-9996-38282e683fd9" containerName="service-proxy" containerID="cri-o://c12909b991ac02943b3ec04df9a2b02c627fc89c2c9d13e7c3443a1dc0fec021" gracePeriod=30 Jun 03 23:30:04.297613 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:04.297583 2568 generic.go:356] "Generic (PLEG): container finished" podID="5d63b520-bbe0-4913-9996-38282e683fd9" containerID="c12909b991ac02943b3ec04df9a2b02c627fc89c2c9d13e7c3443a1dc0fec021" exitCode=2 Jun 03 23:30:04.297715 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:04.297633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" event={"ID":"5d63b520-bbe0-4913-9996-38282e683fd9","Type":"ContainerDied","Data":"c12909b991ac02943b3ec04df9a2b02c627fc89c2c9d13e7c3443a1dc0fec021"} Jun 03 23:30:05.302249 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:30:05.302210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf599cf9-jc8tl" event={"ID":"5d63b520-bbe0-4913-9996-38282e683fd9","Type":"ContainerStarted","Data":"3d6360f68bcd3387355d76a72b706d52b6c0781aa17d3f061fc5bd6229d16652"} Jun 03 23:32:32.904172 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.904131 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m"] Jun 03 23:32:32.907420 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.907392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:32.910373 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.910345 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:32:32.910538 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.910413 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:32:32.911454 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.911436 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:32:32.922488 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.922453 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m"] Jun 03 23:32:32.974744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.974701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjdw\" (UniqueName: \"kubernetes.io/projected/da1c4c6a-09e9-4a43-ae64-37229f287571-kube-api-access-xxjdw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:32.974744 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.974743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:32.974979 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:32.974763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.075228 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.075182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjdw\" (UniqueName: \"kubernetes.io/projected/da1c4c6a-09e9-4a43-ae64-37229f287571-kube-api-access-xxjdw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.075228 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.075226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.075523 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.075244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.075692 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.075670 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.075757 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.075681 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.084947 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.084917 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjdw\" (UniqueName: \"kubernetes.io/projected/da1c4c6a-09e9-4a43-ae64-37229f287571-kube-api-access-xxjdw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.219795 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.219693 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:32:33.227573 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.227537 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:33.376752 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.376601 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m"] Jun 03 23:32:33.379512 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:32:33.379485 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1c4c6a_09e9_4a43_ae64_37229f287571.slice/crio-96ee1a5a3e21ddcb30656821eda3a4d800f89c1cf6ac979137d1ab9398e5b9fc WatchSource:0}: Error finding container 96ee1a5a3e21ddcb30656821eda3a4d800f89c1cf6ac979137d1ab9398e5b9fc: Status 404 returned error can't find the container with id 96ee1a5a3e21ddcb30656821eda3a4d800f89c1cf6ac979137d1ab9398e5b9fc Jun 03 23:32:33.381495 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.381479 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:32:33.777401 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:33.777359 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" event={"ID":"da1c4c6a-09e9-4a43-ae64-37229f287571","Type":"ContainerStarted","Data":"96ee1a5a3e21ddcb30656821eda3a4d800f89c1cf6ac979137d1ab9398e5b9fc"} Jun 03 23:32:39.801661 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:39.801623 2568 generic.go:356] "Generic (PLEG): container finished" podID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerID="5327e7206d730e7ee60da00587bf1f8826d72f25c2b5bd6ed07f962598cb6970" exitCode=0 Jun 03 23:32:39.802163 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:39.801684 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" event={"ID":"da1c4c6a-09e9-4a43-ae64-37229f287571","Type":"ContainerDied","Data":"5327e7206d730e7ee60da00587bf1f8826d72f25c2b5bd6ed07f962598cb6970"} Jun 03 23:32:42.815193 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:42.815159 2568 generic.go:356] "Generic (PLEG): container finished" podID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerID="85d048c66c44a24f3db4c78e267eb42122fdca09c5686892d11ddebb6dddbab1" exitCode=0 Jun 03 23:32:42.815598 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:42.815200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" event={"ID":"da1c4c6a-09e9-4a43-ae64-37229f287571","Type":"ContainerDied","Data":"85d048c66c44a24f3db4c78e267eb42122fdca09c5686892d11ddebb6dddbab1"} Jun 03 23:32:49.843446 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:49.843405 2568 generic.go:356] "Generic (PLEG): container finished" podID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerID="928c744522da35a55bf561962d8f475b0cc27311db71ead7e61a6776bab316da" exitCode=0 Jun 03 23:32:49.843819 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:49.843457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" event={"ID":"da1c4c6a-09e9-4a43-ae64-37229f287571","Type":"ContainerDied","Data":"928c744522da35a55bf561962d8f475b0cc27311db71ead7e61a6776bab316da"} Jun 03 23:32:50.971597 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:50.971573 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:51.022288 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.022253 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-bundle\") pod \"da1c4c6a-09e9-4a43-ae64-37229f287571\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " Jun 03 23:32:51.022463 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.022329 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxjdw\" (UniqueName: \"kubernetes.io/projected/da1c4c6a-09e9-4a43-ae64-37229f287571-kube-api-access-xxjdw\") pod \"da1c4c6a-09e9-4a43-ae64-37229f287571\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " Jun 03 23:32:51.022463 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.022351 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-util\") pod \"da1c4c6a-09e9-4a43-ae64-37229f287571\" (UID: \"da1c4c6a-09e9-4a43-ae64-37229f287571\") " Jun 03 23:32:51.022989 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.022963 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-bundle" (OuterVolumeSpecName: "bundle") pod "da1c4c6a-09e9-4a43-ae64-37229f287571" (UID: "da1c4c6a-09e9-4a43-ae64-37229f287571"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:32:51.024604 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.024576 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1c4c6a-09e9-4a43-ae64-37229f287571-kube-api-access-xxjdw" (OuterVolumeSpecName: "kube-api-access-xxjdw") pod "da1c4c6a-09e9-4a43-ae64-37229f287571" (UID: "da1c4c6a-09e9-4a43-ae64-37229f287571"). InnerVolumeSpecName "kube-api-access-xxjdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:32:51.027686 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.027657 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-util" (OuterVolumeSpecName: "util") pod "da1c4c6a-09e9-4a43-ae64-37229f287571" (UID: "da1c4c6a-09e9-4a43-ae64-37229f287571"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:32:51.123173 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.123099 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxjdw\" (UniqueName: \"kubernetes.io/projected/da1c4c6a-09e9-4a43-ae64-37229f287571-kube-api-access-xxjdw\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:32:51.123173 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.123129 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:32:51.123173 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.123138 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1c4c6a-09e9-4a43-ae64-37229f287571-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:32:51.851775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.851738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" event={"ID":"da1c4c6a-09e9-4a43-ae64-37229f287571","Type":"ContainerDied","Data":"96ee1a5a3e21ddcb30656821eda3a4d800f89c1cf6ac979137d1ab9398e5b9fc"} Jun 03 23:32:51.851775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.851760 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djlb6m" Jun 03 23:32:51.851967 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:51.851786 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96ee1a5a3e21ddcb30656821eda3a4d800f89c1cf6ac979137d1ab9398e5b9fc" Jun 03 23:32:55.842236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842202 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f"] Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842441 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="util" Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842452 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="util" Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842464 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="pull" Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842471 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="pull" Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842479 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="extract" Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842485 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="extract" Jun 03 23:32:55.842726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.842530 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1c4c6a-09e9-4a43-ae64-37229f287571" containerName="extract" Jun 03 23:32:55.895704 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.895661 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f"] Jun 03 23:32:55.895904 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.895778 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:55.899476 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.899453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 23:32:55.899690 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.899675 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wsh9n\"" Jun 03 23:32:55.902128 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.902027 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:32:55.959575 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.959543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/112cb418-81f3-42ca-b30c-6a264b3aa741-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-glf5f\" (UID: \"112cb418-81f3-42ca-b30c-6a264b3aa741\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:55.959575 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:55.959579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwgw7\" (UniqueName: \"kubernetes.io/projected/112cb418-81f3-42ca-b30c-6a264b3aa741-kube-api-access-dwgw7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-glf5f\" (UID: \"112cb418-81f3-42ca-b30c-6a264b3aa741\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:56.061223 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.061176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwgw7\" (UniqueName: \"kubernetes.io/projected/112cb418-81f3-42ca-b30c-6a264b3aa741-kube-api-access-dwgw7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-glf5f\" (UID: \"112cb418-81f3-42ca-b30c-6a264b3aa741\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:56.061562 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.061544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/112cb418-81f3-42ca-b30c-6a264b3aa741-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-glf5f\" (UID: \"112cb418-81f3-42ca-b30c-6a264b3aa741\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:56.062131 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.062106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/112cb418-81f3-42ca-b30c-6a264b3aa741-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-glf5f\" (UID: \"112cb418-81f3-42ca-b30c-6a264b3aa741\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:56.072125 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.072102 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwgw7\" (UniqueName: \"kubernetes.io/projected/112cb418-81f3-42ca-b30c-6a264b3aa741-kube-api-access-dwgw7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-glf5f\" (UID: \"112cb418-81f3-42ca-b30c-6a264b3aa741\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:56.204273 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.204181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" Jun 03 23:32:56.357636 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.357602 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f"] Jun 03 23:32:56.361651 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:32:56.361627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112cb418_81f3_42ca_b30c_6a264b3aa741.slice/crio-976e24fb7a854e97558da2da970a1f2afe67084349d7c5fa4e974ffcd4e179ec WatchSource:0}: Error finding container 976e24fb7a854e97558da2da970a1f2afe67084349d7c5fa4e974ffcd4e179ec: Status 404 returned error can't find the container with id 976e24fb7a854e97558da2da970a1f2afe67084349d7c5fa4e974ffcd4e179ec Jun 03 23:32:56.870079 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:56.870042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" event={"ID":"112cb418-81f3-42ca-b30c-6a264b3aa741","Type":"ContainerStarted","Data":"976e24fb7a854e97558da2da970a1f2afe67084349d7c5fa4e974ffcd4e179ec"} Jun 03 23:32:58.879167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:58.879136 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" event={"ID":"112cb418-81f3-42ca-b30c-6a264b3aa741","Type":"ContainerStarted","Data":"2fda8242f4452dcf4c699dc786d537e6e78cfa3e9909abd7ef8b4c867841f3b0"} Jun 03 23:32:58.905214 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:32:58.905169 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-glf5f" podStartSLOduration=1.747980939 podStartE2EDuration="3.905153605s" totalImagesPullingTime="2.157172666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:58.90398218 +0000 UTC m=+506.153824309" watchObservedRunningTime="2026-06-03 23:32:58.905153605 +0000 UTC m=+506.154995723" Jun 03 23:33:00.353469 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.353436 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl"] Jun 03 23:33:00.375461 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.375432 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl"] Jun 03 23:33:00.375622 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.375532 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.378450 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.378385 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:33:00.378725 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.378706 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:33:00.379307 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.379290 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:33:00.490403 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.490371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.490582 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.490414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8km9\" (UniqueName: \"kubernetes.io/projected/1dd9a3ac-5aef-4faa-b4eb-953454d95871-kube-api-access-g8km9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.490582 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.490443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.591693 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.591654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.591890 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.591702 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8km9\" (UniqueName: \"kubernetes.io/projected/1dd9a3ac-5aef-4faa-b4eb-953454d95871-kube-api-access-g8km9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.591890 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.591738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.592158 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.592137 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.592193 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.592137 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.602334 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.602303 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8km9\" (UniqueName: \"kubernetes.io/projected/1dd9a3ac-5aef-4faa-b4eb-953454d95871-kube-api-access-g8km9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.687506 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.687424 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:00.846968 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.846939 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl"] Jun 03 23:33:00.849224 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:33:00.849188 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd9a3ac_5aef_4faa_b4eb_953454d95871.slice/crio-55358a05ffd13ed6b2190145a1f3aee5780644777b98a1dba9e53628a4966638 WatchSource:0}: Error finding container 55358a05ffd13ed6b2190145a1f3aee5780644777b98a1dba9e53628a4966638: Status 404 returned error can't find the container with id 55358a05ffd13ed6b2190145a1f3aee5780644777b98a1dba9e53628a4966638 Jun 03 23:33:00.887826 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:00.887802 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" event={"ID":"1dd9a3ac-5aef-4faa-b4eb-953454d95871","Type":"ContainerStarted","Data":"55358a05ffd13ed6b2190145a1f3aee5780644777b98a1dba9e53628a4966638"} Jun 03 23:33:01.895079 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:01.894990 2568 generic.go:356] "Generic (PLEG): container finished" podID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerID="3dd9930d3116f7ecc063421384207a417436d949d306b9f64e0008937f5ea437" exitCode=0 Jun 03 23:33:01.895079 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:01.895031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" event={"ID":"1dd9a3ac-5aef-4faa-b4eb-953454d95871","Type":"ContainerDied","Data":"3dd9930d3116f7ecc063421384207a417436d949d306b9f64e0008937f5ea437"} Jun 03 23:33:03.905630 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:03.905592 2568 generic.go:356] "Generic (PLEG): container finished" podID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerID="b4aaf2ef2d9433a04013a057920aba4ccefa533dba37be64a84ac504bc934e28" exitCode=0 Jun 03 23:33:03.906039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:03.905667 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" event={"ID":"1dd9a3ac-5aef-4faa-b4eb-953454d95871","Type":"ContainerDied","Data":"b4aaf2ef2d9433a04013a057920aba4ccefa533dba37be64a84ac504bc934e28"} Jun 03 23:33:04.913712 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:04.913676 2568 generic.go:356] "Generic (PLEG): container finished" podID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerID="8f5d9d2c07721017e7364edca41246b7c0d3334898ce2f27a2ed02f1af44010d" exitCode=0 Jun 03 23:33:04.914119 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:04.913756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" event={"ID":"1dd9a3ac-5aef-4faa-b4eb-953454d95871","Type":"ContainerDied","Data":"8f5d9d2c07721017e7364edca41246b7c0d3334898ce2f27a2ed02f1af44010d"} Jun 03 23:33:06.037695 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.037667 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:06.136498 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.136451 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-bundle\") pod \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " Jun 03 23:33:06.136692 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.136527 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-util\") pod \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " Jun 03 23:33:06.136692 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.136581 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8km9\" (UniqueName: \"kubernetes.io/projected/1dd9a3ac-5aef-4faa-b4eb-953454d95871-kube-api-access-g8km9\") pod \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\" (UID: \"1dd9a3ac-5aef-4faa-b4eb-953454d95871\") " Jun 03 23:33:06.136817 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.136783 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-bundle" (OuterVolumeSpecName: "bundle") pod "1dd9a3ac-5aef-4faa-b4eb-953454d95871" (UID: "1dd9a3ac-5aef-4faa-b4eb-953454d95871"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:06.138623 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.138603 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd9a3ac-5aef-4faa-b4eb-953454d95871-kube-api-access-g8km9" (OuterVolumeSpecName: "kube-api-access-g8km9") pod "1dd9a3ac-5aef-4faa-b4eb-953454d95871" (UID: "1dd9a3ac-5aef-4faa-b4eb-953454d95871"). InnerVolumeSpecName "kube-api-access-g8km9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:33:06.202408 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.202320 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-util" (OuterVolumeSpecName: "util") pod "1dd9a3ac-5aef-4faa-b4eb-953454d95871" (UID: "1dd9a3ac-5aef-4faa-b4eb-953454d95871"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:06.237389 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.237353 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:33:06.237389 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.237382 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd9a3ac-5aef-4faa-b4eb-953454d95871-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:33:06.237389 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.237392 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8km9\" (UniqueName: \"kubernetes.io/projected/1dd9a3ac-5aef-4faa-b4eb-953454d95871-kube-api-access-g8km9\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:33:06.927049 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.927016 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" Jun 03 23:33:06.927251 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.927015 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxjqdl" event={"ID":"1dd9a3ac-5aef-4faa-b4eb-953454d95871","Type":"ContainerDied","Data":"55358a05ffd13ed6b2190145a1f3aee5780644777b98a1dba9e53628a4966638"} Jun 03 23:33:06.927251 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:06.927167 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55358a05ffd13ed6b2190145a1f3aee5780644777b98a1dba9e53628a4966638" Jun 03 23:33:29.044782 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044705 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs"] Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044952 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="extract" Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044963 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="extract" Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044980 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="util" Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044986 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="util" Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044991 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="pull" Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.044997 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="pull" Jun 03 23:33:29.045414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.045038 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd9a3ac-5aef-4faa-b4eb-953454d95871" containerName="extract" Jun 03 23:33:29.047054 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.047038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.049913 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.049889 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:33:29.050786 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.050769 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:33:29.050862 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.050782 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:33:29.062399 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.062372 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs"] Jun 03 23:33:29.109314 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.109281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.109487 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.109338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.109487 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.109366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54jm\" (UniqueName: \"kubernetes.io/projected/f7842261-e186-4f51-a71b-a1fbeba1c345-kube-api-access-n54jm\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.209990 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.209950 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.210167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.210008 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.210167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.210032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54jm\" (UniqueName: \"kubernetes.io/projected/f7842261-e186-4f51-a71b-a1fbeba1c345-kube-api-access-n54jm\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.210364 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.210343 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.210418 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.210399 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.219612 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.219583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54jm\" (UniqueName: \"kubernetes.io/projected/f7842261-e186-4f51-a71b-a1fbeba1c345-kube-api-access-n54jm\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.355637 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.355611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:29.485991 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:29.485962 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs"] Jun 03 23:33:29.488990 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:33:29.488959 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7842261_e186_4f51_a71b_a1fbeba1c345.slice/crio-a135b6d2b60e31e868e01d9270ec9e2d573d95b882fad52cafeb564cd6d686cb WatchSource:0}: Error finding container a135b6d2b60e31e868e01d9270ec9e2d573d95b882fad52cafeb564cd6d686cb: Status 404 returned error can't find the container with id a135b6d2b60e31e868e01d9270ec9e2d573d95b882fad52cafeb564cd6d686cb Jun 03 23:33:30.017141 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:30.017105 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerID="cb546e84bed0281de86d64d46775abe933223da1fd2abc54721c665c7a50ad0f" exitCode=0 Jun 03 23:33:30.017315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:30.017191 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" event={"ID":"f7842261-e186-4f51-a71b-a1fbeba1c345","Type":"ContainerDied","Data":"cb546e84bed0281de86d64d46775abe933223da1fd2abc54721c665c7a50ad0f"} Jun 03 23:33:30.017315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:30.017241 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" event={"ID":"f7842261-e186-4f51-a71b-a1fbeba1c345","Type":"ContainerStarted","Data":"a135b6d2b60e31e868e01d9270ec9e2d573d95b882fad52cafeb564cd6d686cb"} Jun 03 23:33:31.022523 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:31.022491 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerID="9c8a2ed2e7e0f3b7f19e9fcdcd2bc7f31e8c95e7c52440f75175f1e1539524ab" exitCode=0 Jun 03 23:33:31.022941 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:31.022576 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" event={"ID":"f7842261-e186-4f51-a71b-a1fbeba1c345","Type":"ContainerDied","Data":"9c8a2ed2e7e0f3b7f19e9fcdcd2bc7f31e8c95e7c52440f75175f1e1539524ab"} Jun 03 23:33:32.029155 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:32.029120 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerID="9fdea40157f0f3ee2ab2449dd0ad1af5c825f21757ce349d701d68a7aae932d1" exitCode=0 Jun 03 23:33:32.029574 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:32.029191 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" event={"ID":"f7842261-e186-4f51-a71b-a1fbeba1c345","Type":"ContainerDied","Data":"9fdea40157f0f3ee2ab2449dd0ad1af5c825f21757ce349d701d68a7aae932d1"} Jun 03 23:33:33.157316 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.157291 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:33.236437 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.236411 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-util\") pod \"f7842261-e186-4f51-a71b-a1fbeba1c345\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " Jun 03 23:33:33.236644 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.236454 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-bundle\") pod \"f7842261-e186-4f51-a71b-a1fbeba1c345\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " Jun 03 23:33:33.236644 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.236483 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n54jm\" (UniqueName: \"kubernetes.io/projected/f7842261-e186-4f51-a71b-a1fbeba1c345-kube-api-access-n54jm\") pod \"f7842261-e186-4f51-a71b-a1fbeba1c345\" (UID: \"f7842261-e186-4f51-a71b-a1fbeba1c345\") " Jun 03 23:33:33.237369 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.237341 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-bundle" (OuterVolumeSpecName: "bundle") pod "f7842261-e186-4f51-a71b-a1fbeba1c345" (UID: "f7842261-e186-4f51-a71b-a1fbeba1c345"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:33.238479 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.238447 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7842261-e186-4f51-a71b-a1fbeba1c345-kube-api-access-n54jm" (OuterVolumeSpecName: "kube-api-access-n54jm") pod "f7842261-e186-4f51-a71b-a1fbeba1c345" (UID: "f7842261-e186-4f51-a71b-a1fbeba1c345"). InnerVolumeSpecName "kube-api-access-n54jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:33:33.242265 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.242242 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-util" (OuterVolumeSpecName: "util") pod "f7842261-e186-4f51-a71b-a1fbeba1c345" (UID: "f7842261-e186-4f51-a71b-a1fbeba1c345"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:33.337781 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.337699 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:33:33.337781 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.337725 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7842261-e186-4f51-a71b-a1fbeba1c345-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:33:33.337781 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:33.337734 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n54jm\" (UniqueName: \"kubernetes.io/projected/f7842261-e186-4f51-a71b-a1fbeba1c345-kube-api-access-n54jm\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:33:34.038436 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:34.038400 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" event={"ID":"f7842261-e186-4f51-a71b-a1fbeba1c345","Type":"ContainerDied","Data":"a135b6d2b60e31e868e01d9270ec9e2d573d95b882fad52cafeb564cd6d686cb"} Jun 03 23:33:34.038582 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:34.038445 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd26pxs" Jun 03 23:33:34.038582 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:34.038451 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a135b6d2b60e31e868e01d9270ec9e2d573d95b882fad52cafeb564cd6d686cb" Jun 03 23:33:41.873379 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873338 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d"] Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873586 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="pull" Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873596 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="pull" Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873607 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="extract" Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873613 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="extract" Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873622 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="util" Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873627 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="util" Jun 03 23:33:41.873909 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.873669 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7842261-e186-4f51-a71b-a1fbeba1c345" containerName="extract" Jun 03 23:33:41.878153 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.878129 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:41.882873 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.882828 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 23:33:41.883046 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.882890 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 23:33:41.883728 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.883707 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4jsbw\"" Jun 03 23:33:41.883785 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.883745 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 23:33:41.884001 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.883974 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 23:33:41.900045 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.900005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a1eb756-f4e9-4889-899a-121c334823ca-manifests\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:41.900045 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.900051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a1eb756-f4e9-4889-899a-121c334823ca-tmp\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:41.900272 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.900075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a1eb756-f4e9-4889-899a-121c334823ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:41.900272 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.900134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxpl\" (UniqueName: \"kubernetes.io/projected/5a1eb756-f4e9-4889-899a-121c334823ca-kube-api-access-8zxpl\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:41.900272 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.900161 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1eb756-f4e9-4889-899a-121c334823ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:41.912933 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:41.912898 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d"] Jun 03 23:33:42.001035 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.000991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a1eb756-f4e9-4889-899a-121c334823ca-manifests\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.001236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.001049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a1eb756-f4e9-4889-899a-121c334823ca-tmp\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.001236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.001082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a1eb756-f4e9-4889-899a-121c334823ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.001236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.001122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxpl\" (UniqueName: \"kubernetes.io/projected/5a1eb756-f4e9-4889-899a-121c334823ca-kube-api-access-8zxpl\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.001400 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.001261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1eb756-f4e9-4889-899a-121c334823ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.001449 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.001425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a1eb756-f4e9-4889-899a-121c334823ca-manifests\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.003376 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.003346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a1eb756-f4e9-4889-899a-121c334823ca-tmp\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.003759 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.003737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1eb756-f4e9-4889-899a-121c334823ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.003800 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.003737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a1eb756-f4e9-4889-899a-121c334823ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.010617 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.010586 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxpl\" (UniqueName: \"kubernetes.io/projected/5a1eb756-f4e9-4889-899a-121c334823ca-kube-api-access-8zxpl\") pod \"opendatahub-operator-controller-manager-f87df8b57-ww92d\" (UID: \"5a1eb756-f4e9-4889-899a-121c334823ca\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.189151 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.189045 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:42.337973 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:42.337934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d"] Jun 03 23:33:42.342657 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:33:42.342623 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1eb756_f4e9_4889_899a_121c334823ca.slice/crio-33e1520375f429d6d121946f7baa6ca6b49da3b5cc50c8b1ac592617a044d441 WatchSource:0}: Error finding container 33e1520375f429d6d121946f7baa6ca6b49da3b5cc50c8b1ac592617a044d441: Status 404 returned error can't find the container with id 33e1520375f429d6d121946f7baa6ca6b49da3b5cc50c8b1ac592617a044d441 Jun 03 23:33:43.077625 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:43.077571 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" event={"ID":"5a1eb756-f4e9-4889-899a-121c334823ca","Type":"ContainerStarted","Data":"33e1520375f429d6d121946f7baa6ca6b49da3b5cc50c8b1ac592617a044d441"} Jun 03 23:33:46.096256 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:46.096219 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" event={"ID":"5a1eb756-f4e9-4889-899a-121c334823ca","Type":"ContainerStarted","Data":"67e3a7ad9fedae08afc9ae92f81d14ca72f950170ae2bb087d46a10cdc7aefc3"} Jun 03 23:33:47.106637 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:47.106600 2568 generic.go:356] "Generic (PLEG): container finished" podID="5a1eb756-f4e9-4889-899a-121c334823ca" containerID="67e3a7ad9fedae08afc9ae92f81d14ca72f950170ae2bb087d46a10cdc7aefc3" exitCode=0 Jun 03 23:33:47.107038 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:47.106670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" event={"ID":"5a1eb756-f4e9-4889-899a-121c334823ca","Type":"ContainerDied","Data":"67e3a7ad9fedae08afc9ae92f81d14ca72f950170ae2bb087d46a10cdc7aefc3"} Jun 03 23:33:48.113444 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:48.113406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" event={"ID":"5a1eb756-f4e9-4889-899a-121c334823ca","Type":"ContainerStarted","Data":"d1bc7ea986e60e6266615589ffd046a6563d1dc0ff8b1a4068faabd8e9cc5e76"} Jun 03 23:33:48.113836 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:48.113511 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:59.119597 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:59.119561 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" Jun 03 23:33:59.148382 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:33:59.148322 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ww92d" podStartSLOduration=14.055603957 podStartE2EDuration="18.148305227s" totalImagesPullingTime="3.09575201s" totalInitContainerRuntime="996.94926ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:33:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:33:48.173644066 +0000 UTC m=+555.423486185" watchObservedRunningTime="2026-06-03 23:33:59.148305227 +0000 UTC m=+566.398147345" Jun 03 23:34:01.457800 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.457757 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-x5wpn"] Jun 03 23:34:01.461010 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.460986 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:01.464335 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.464307 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wt8s8\"" Jun 03 23:34:01.464606 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.464591 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 23:34:01.474528 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.474499 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-x5wpn"] Jun 03 23:34:01.558738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.558696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d56378-7f49-45e3-a031-5c218c092bd4-cert\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:01.558953 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.558760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zphx5\" (UniqueName: \"kubernetes.io/projected/b8d56378-7f49-45e3-a031-5c218c092bd4-kube-api-access-zphx5\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:01.660064 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.660019 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zphx5\" (UniqueName: \"kubernetes.io/projected/b8d56378-7f49-45e3-a031-5c218c092bd4-kube-api-access-zphx5\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:01.660244 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.660093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d56378-7f49-45e3-a031-5c218c092bd4-cert\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:01.660244 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:34:01.660193 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 23:34:01.660321 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:34:01.660252 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d56378-7f49-45e3-a031-5c218c092bd4-cert podName:b8d56378-7f49-45e3-a031-5c218c092bd4 nodeName:}" failed. No retries permitted until 2026-06-03 23:34:02.160235723 +0000 UTC m=+569.410077819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d56378-7f49-45e3-a031-5c218c092bd4-cert") pod "odh-model-controller-6dc94f689f-x5wpn" (UID: "b8d56378-7f49-45e3-a031-5c218c092bd4") : secret "odh-model-controller-webhook-cert" not found Jun 03 23:34:01.671287 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:01.671256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zphx5\" (UniqueName: \"kubernetes.io/projected/b8d56378-7f49-45e3-a031-5c218c092bd4-kube-api-access-zphx5\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:02.118027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.117992 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-s96x5"] Jun 03 23:34:02.121176 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.121159 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.124387 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.124367 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 23:34:02.142424 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.142387 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-s96x5"] Jun 03 23:34:02.164090 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.164056 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-tls-certs\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.164289 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.164128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d56378-7f49-45e3-a031-5c218c092bd4-cert\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:02.164289 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.164150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv2ns\" (UniqueName: \"kubernetes.io/projected/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-kube-api-access-pv2ns\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.166671 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.166647 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d56378-7f49-45e3-a031-5c218c092bd4-cert\") pod \"odh-model-controller-6dc94f689f-x5wpn\" (UID: \"b8d56378-7f49-45e3-a031-5c218c092bd4\") " pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:02.265267 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.265208 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-tls-certs\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.265454 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.265316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv2ns\" (UniqueName: \"kubernetes.io/projected/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-kube-api-access-pv2ns\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.265454 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:34:02.265364 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 03 23:34:02.265454 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:34:02.265430 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-tls-certs podName:5d17ec06-df98-4a6b-b2de-2c027eeb3d70 nodeName:}" failed. No retries permitted until 2026-06-03 23:34:02.765413474 +0000 UTC m=+570.015255570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-tls-certs") pod "model-serving-api-5dd488fc48-s96x5" (UID: "5d17ec06-df98-4a6b-b2de-2c027eeb3d70") : secret "model-serving-api-tls" not found Jun 03 23:34:02.282622 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.282592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv2ns\" (UniqueName: \"kubernetes.io/projected/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-kube-api-access-pv2ns\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.370713 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.370610 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:02.508974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.508945 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-x5wpn"] Jun 03 23:34:02.511264 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:02.511233 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d56378_7f49_45e3_a031_5c218c092bd4.slice/crio-85b98d9f75bc0076933bafa2307907e03ccdb3a71422f9f2748f145ea3dc2c4a WatchSource:0}: Error finding container 85b98d9f75bc0076933bafa2307907e03ccdb3a71422f9f2748f145ea3dc2c4a: Status 404 returned error can't find the container with id 85b98d9f75bc0076933bafa2307907e03ccdb3a71422f9f2748f145ea3dc2c4a Jun 03 23:34:02.770135 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.770040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-tls-certs\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.772533 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.772491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d17ec06-df98-4a6b-b2de-2c027eeb3d70-tls-certs\") pod \"model-serving-api-5dd488fc48-s96x5\" (UID: \"5d17ec06-df98-4a6b-b2de-2c027eeb3d70\") " pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:02.814376 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.814339 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh"] Jun 03 23:34:02.818837 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.818817 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.821601 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.821567 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:34:02.821727 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.821710 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:34:02.821805 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.821786 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:34:02.829934 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.829895 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh"] Jun 03 23:34:02.870897 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.870828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.871086 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.870916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.871086 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.870947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmmr\" (UniqueName: \"kubernetes.io/projected/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-kube-api-access-6gmmr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.887651 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.887614 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57684f659d-p8ghl"] Jun 03 23:34:02.890674 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.890653 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:02.893398 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.893373 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 23:34:02.893547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.893423 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 23:34:02.893547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.893471 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9xnmf\"" Jun 03 23:34:02.893547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.893491 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 23:34:02.893547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.893540 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 23:34:02.902918 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.902890 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57684f659d-p8ghl"] Jun 03 23:34:02.972331 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5820911-1b21-42df-ad5c-3d74522aa540-tmp\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:02.972531 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.972531 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.972531 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5820911-1b21-42df-ad5c-3d74522aa540-tls-certs\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:02.972691 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdqdz\" (UniqueName: \"kubernetes.io/projected/b5820911-1b21-42df-ad5c-3d74522aa540-kube-api-access-kdqdz\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:02.972691 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmmr\" (UniqueName: \"kubernetes.io/projected/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-kube-api-access-6gmmr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.972822 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.972965 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.972940 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:02.981661 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:02.981625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmmr\" (UniqueName: \"kubernetes.io/projected/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-kube-api-access-6gmmr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:03.031218 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.031115 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:03.073598 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.073554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5820911-1b21-42df-ad5c-3d74522aa540-tls-certs\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.073789 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.073624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdqdz\" (UniqueName: \"kubernetes.io/projected/b5820911-1b21-42df-ad5c-3d74522aa540-kube-api-access-kdqdz\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.073789 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.073695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5820911-1b21-42df-ad5c-3d74522aa540-tmp\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.077428 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.077395 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5820911-1b21-42df-ad5c-3d74522aa540-tmp\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.077609 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.077544 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5820911-1b21-42df-ad5c-3d74522aa540-tls-certs\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.085990 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.085956 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdqdz\" (UniqueName: \"kubernetes.io/projected/b5820911-1b21-42df-ad5c-3d74522aa540-kube-api-access-kdqdz\") pod \"kube-auth-proxy-57684f659d-p8ghl\" (UID: \"b5820911-1b21-42df-ad5c-3d74522aa540\") " pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.128979 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.128941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:03.182669 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.182622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" event={"ID":"b8d56378-7f49-45e3-a031-5c218c092bd4","Type":"ContainerStarted","Data":"85b98d9f75bc0076933bafa2307907e03ccdb3a71422f9f2748f145ea3dc2c4a"} Jun 03 23:34:03.200041 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.199977 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" Jun 03 23:34:03.225546 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:03.225489 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d17ec06_df98_4a6b_b2de_2c027eeb3d70.slice/crio-26f0c7e979a190324142ab44b9ef72eb0a70fe632ecbeaa52b46da4dbc06f1ce WatchSource:0}: Error finding container 26f0c7e979a190324142ab44b9ef72eb0a70fe632ecbeaa52b46da4dbc06f1ce: Status 404 returned error can't find the container with id 26f0c7e979a190324142ab44b9ef72eb0a70fe632ecbeaa52b46da4dbc06f1ce Jun 03 23:34:03.227222 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.227193 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-s96x5"] Jun 03 23:34:03.307492 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.307350 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh"] Jun 03 23:34:03.311886 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:03.311723 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ec37da_804b_48e4_ba88_ddb2b2e3c7be.slice/crio-e879581f81a9df80a299f6e2e9ada29c4def25f46d8023dfc224f3b135e60c34 WatchSource:0}: Error finding container e879581f81a9df80a299f6e2e9ada29c4def25f46d8023dfc224f3b135e60c34: Status 404 returned error can't find the container with id e879581f81a9df80a299f6e2e9ada29c4def25f46d8023dfc224f3b135e60c34 Jun 03 23:34:03.416047 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:03.416006 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57684f659d-p8ghl"] Jun 03 23:34:03.420015 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:03.419982 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5820911_1b21_42df_ad5c_3d74522aa540.slice/crio-9636a486aaa0caf4564bedea3af6c6ea13ba5e3676a610cb1be2fe12cff9ebce WatchSource:0}: Error finding container 9636a486aaa0caf4564bedea3af6c6ea13ba5e3676a610cb1be2fe12cff9ebce: Status 404 returned error can't find the container with id 9636a486aaa0caf4564bedea3af6c6ea13ba5e3676a610cb1be2fe12cff9ebce Jun 03 23:34:04.192775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:04.192412 2568 generic.go:356] "Generic (PLEG): container finished" podID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerID="8cbe0393a3cecf03374f8824c48d6b9f06d848d4e9548998a5da3afa21961f5a" exitCode=0 Jun 03 23:34:04.192775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:04.192454 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" event={"ID":"06ec37da-804b-48e4-ba88-ddb2b2e3c7be","Type":"ContainerDied","Data":"8cbe0393a3cecf03374f8824c48d6b9f06d848d4e9548998a5da3afa21961f5a"} Jun 03 23:34:04.192775 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:04.192521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" event={"ID":"06ec37da-804b-48e4-ba88-ddb2b2e3c7be","Type":"ContainerStarted","Data":"e879581f81a9df80a299f6e2e9ada29c4def25f46d8023dfc224f3b135e60c34"} Jun 03 23:34:04.197068 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:04.196984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" event={"ID":"b5820911-1b21-42df-ad5c-3d74522aa540","Type":"ContainerStarted","Data":"9636a486aaa0caf4564bedea3af6c6ea13ba5e3676a610cb1be2fe12cff9ebce"} Jun 03 23:34:04.199315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:04.199285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" event={"ID":"5d17ec06-df98-4a6b-b2de-2c027eeb3d70","Type":"ContainerStarted","Data":"26f0c7e979a190324142ab44b9ef72eb0a70fe632ecbeaa52b46da4dbc06f1ce"} Jun 03 23:34:08.221253 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.221209 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" event={"ID":"b8d56378-7f49-45e3-a031-5c218c092bd4","Type":"ContainerStarted","Data":"475ced833eede4f3fc7a20bb70bd20f7b33e19d6dee72947c6302007ef18c73f"} Jun 03 23:34:08.221701 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.221308 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:08.223024 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.223001 2568 generic.go:356] "Generic (PLEG): container finished" podID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerID="130b7edfab22aa5b353d998c1981b37d28c433df031d84e706b2d2a697095e80" exitCode=0 Jun 03 23:34:08.223134 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.223075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" event={"ID":"06ec37da-804b-48e4-ba88-ddb2b2e3c7be","Type":"ContainerDied","Data":"130b7edfab22aa5b353d998c1981b37d28c433df031d84e706b2d2a697095e80"} Jun 03 23:34:08.224809 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.224782 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" event={"ID":"b5820911-1b21-42df-ad5c-3d74522aa540","Type":"ContainerStarted","Data":"5571e6ef7cb75adbd9ccacfebe7f4f423335d7a7053a4ec352803c409d9c57ad"} Jun 03 23:34:08.226183 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.226163 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" event={"ID":"5d17ec06-df98-4a6b-b2de-2c027eeb3d70","Type":"ContainerStarted","Data":"41a774ab3e40dedf48dc56242eb8ab809e6d45ea1f81c8e67fb0af15ad8f7589"} Jun 03 23:34:08.227585 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.227565 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:08.239101 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.239046 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" podStartSLOduration=2.339044443 podStartE2EDuration="7.239023455s" totalImagesPullingTime="4.899979012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:08.238463929 +0000 UTC m=+575.488306048" watchObservedRunningTime="2026-06-03 23:34:08.239023455 +0000 UTC m=+575.488865575" Jun 03 23:34:08.280408 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.280356 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" podStartSLOduration=2.095812393 podStartE2EDuration="6.280338774s" totalImagesPullingTime="4.184526381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:08.278783036 +0000 UTC m=+575.528625153" watchObservedRunningTime="2026-06-03 23:34:08.280338774 +0000 UTC m=+575.530180891" Jun 03 23:34:08.298994 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:08.298941 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57684f659d-p8ghl" podStartSLOduration=2.284297573 podStartE2EDuration="6.298927943s" totalImagesPullingTime="4.01463037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:08.298201241 +0000 UTC m=+575.548043361" watchObservedRunningTime="2026-06-03 23:34:08.298927943 +0000 UTC m=+575.548770061" Jun 03 23:34:09.232345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:09.232296 2568 generic.go:356] "Generic (PLEG): container finished" podID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerID="850070d8c06d61c4f2de5dced1b6305d444752b26632bf00cee9cbec81245054" exitCode=0 Jun 03 23:34:09.232784 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:09.232379 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" event={"ID":"06ec37da-804b-48e4-ba88-ddb2b2e3c7be","Type":"ContainerDied","Data":"850070d8c06d61c4f2de5dced1b6305d444752b26632bf00cee9cbec81245054"} Jun 03 23:34:10.370606 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.370569 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:10.441053 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.441013 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-bundle\") pod \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " Jun 03 23:34:10.441245 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.441114 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gmmr\" (UniqueName: \"kubernetes.io/projected/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-kube-api-access-6gmmr\") pod \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " Jun 03 23:34:10.441245 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.441159 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-util\") pod \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\" (UID: \"06ec37da-804b-48e4-ba88-ddb2b2e3c7be\") " Jun 03 23:34:10.442041 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.442006 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-bundle" (OuterVolumeSpecName: "bundle") pod "06ec37da-804b-48e4-ba88-ddb2b2e3c7be" (UID: "06ec37da-804b-48e4-ba88-ddb2b2e3c7be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:10.443174 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.443138 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-kube-api-access-6gmmr" (OuterVolumeSpecName: "kube-api-access-6gmmr") pod "06ec37da-804b-48e4-ba88-ddb2b2e3c7be" (UID: "06ec37da-804b-48e4-ba88-ddb2b2e3c7be"). InnerVolumeSpecName "kube-api-access-6gmmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:10.445773 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.445703 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-util" (OuterVolumeSpecName: "util") pod "06ec37da-804b-48e4-ba88-ddb2b2e3c7be" (UID: "06ec37da-804b-48e4-ba88-ddb2b2e3c7be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:10.542017 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.541937 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:34:10.542017 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.541966 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gmmr\" (UniqueName: \"kubernetes.io/projected/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-kube-api-access-6gmmr\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:34:10.542017 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:10.541977 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06ec37da-804b-48e4-ba88-ddb2b2e3c7be-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:34:11.245041 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:11.245007 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" event={"ID":"06ec37da-804b-48e4-ba88-ddb2b2e3c7be","Type":"ContainerDied","Data":"e879581f81a9df80a299f6e2e9ada29c4def25f46d8023dfc224f3b135e60c34"} Jun 03 23:34:11.245207 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:11.245047 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c2lhh" Jun 03 23:34:11.245207 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:11.245056 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e879581f81a9df80a299f6e2e9ada29c4def25f46d8023dfc224f3b135e60c34" Jun 03 23:34:12.267969 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.267932 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-csdmj"] Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268206 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="pull" Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268218 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="pull" Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268229 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="util" Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268234 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="util" Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268253 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="extract" Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268258 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="extract" Jun 03 23:34:12.268329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.268301 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ec37da-804b-48e4-ba88-ddb2b2e3c7be" containerName="extract" Jun 03 23:34:12.275244 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.275211 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.279380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.279354 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 23:34:12.279501 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.279354 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wr4dz\"" Jun 03 23:34:12.284573 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.284550 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn"] Jun 03 23:34:12.288169 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.288146 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.291738 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.291670 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 23:34:12.292145 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.292123 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vnmdd\"" Jun 03 23:34:12.292236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.292191 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-csdmj"] Jun 03 23:34:12.311399 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.311365 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn"] Jun 03 23:34:12.357184 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.357145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b638dea-4302-48a6-98dd-6a4a105cbc1e-cert\") pod \"kserve-controller-manager-69fc866d76-csdmj\" (UID: \"6b638dea-4302-48a6-98dd-6a4a105cbc1e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.357184 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.357183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0ec0619-1e89-46e0-91e9-28ec0496ee1d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kq2sn\" (UID: \"f0ec0619-1e89-46e0-91e9-28ec0496ee1d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.357399 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.357221 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd47f\" (UniqueName: \"kubernetes.io/projected/6b638dea-4302-48a6-98dd-6a4a105cbc1e-kube-api-access-qd47f\") pod \"kserve-controller-manager-69fc866d76-csdmj\" (UID: \"6b638dea-4302-48a6-98dd-6a4a105cbc1e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.357399 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.357287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4dc\" (UniqueName: \"kubernetes.io/projected/f0ec0619-1e89-46e0-91e9-28ec0496ee1d-kube-api-access-kj4dc\") pod \"llmisvc-controller-manager-864bfd7bc9-kq2sn\" (UID: \"f0ec0619-1e89-46e0-91e9-28ec0496ee1d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.458523 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.458482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b638dea-4302-48a6-98dd-6a4a105cbc1e-cert\") pod \"kserve-controller-manager-69fc866d76-csdmj\" (UID: \"6b638dea-4302-48a6-98dd-6a4a105cbc1e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.458523 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.458521 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0ec0619-1e89-46e0-91e9-28ec0496ee1d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kq2sn\" (UID: \"f0ec0619-1e89-46e0-91e9-28ec0496ee1d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.458751 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.458546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd47f\" (UniqueName: \"kubernetes.io/projected/6b638dea-4302-48a6-98dd-6a4a105cbc1e-kube-api-access-qd47f\") pod \"kserve-controller-manager-69fc866d76-csdmj\" (UID: \"6b638dea-4302-48a6-98dd-6a4a105cbc1e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.458751 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.458573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4dc\" (UniqueName: \"kubernetes.io/projected/f0ec0619-1e89-46e0-91e9-28ec0496ee1d-kube-api-access-kj4dc\") pod \"llmisvc-controller-manager-864bfd7bc9-kq2sn\" (UID: \"f0ec0619-1e89-46e0-91e9-28ec0496ee1d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.461119 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.461089 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b638dea-4302-48a6-98dd-6a4a105cbc1e-cert\") pod \"kserve-controller-manager-69fc866d76-csdmj\" (UID: \"6b638dea-4302-48a6-98dd-6a4a105cbc1e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.461219 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.461144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0ec0619-1e89-46e0-91e9-28ec0496ee1d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kq2sn\" (UID: \"f0ec0619-1e89-46e0-91e9-28ec0496ee1d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.471438 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.471410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4dc\" (UniqueName: \"kubernetes.io/projected/f0ec0619-1e89-46e0-91e9-28ec0496ee1d-kube-api-access-kj4dc\") pod \"llmisvc-controller-manager-864bfd7bc9-kq2sn\" (UID: \"f0ec0619-1e89-46e0-91e9-28ec0496ee1d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.471541 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.471419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd47f\" (UniqueName: \"kubernetes.io/projected/6b638dea-4302-48a6-98dd-6a4a105cbc1e-kube-api-access-qd47f\") pod \"kserve-controller-manager-69fc866d76-csdmj\" (UID: \"6b638dea-4302-48a6-98dd-6a4a105cbc1e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.585807 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.585710 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:12.597707 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.597670 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:12.753795 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.753760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-csdmj"] Jun 03 23:34:12.756933 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:12.756885 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b638dea_4302_48a6_98dd_6a4a105cbc1e.slice/crio-fb90d8977e62c8ba1a3fbcd6e24a59a7a46122bfd58ce531c22f9981f468a82c WatchSource:0}: Error finding container fb90d8977e62c8ba1a3fbcd6e24a59a7a46122bfd58ce531c22f9981f468a82c: Status 404 returned error can't find the container with id fb90d8977e62c8ba1a3fbcd6e24a59a7a46122bfd58ce531c22f9981f468a82c Jun 03 23:34:12.778020 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:12.777994 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn"] Jun 03 23:34:12.779948 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:12.779921 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0ec0619_1e89_46e0_91e9_28ec0496ee1d.slice/crio-1133640bfc88a18d625f0cf75aeeaa41a2491f450705e3555925514cb6b60aa9 WatchSource:0}: Error finding container 1133640bfc88a18d625f0cf75aeeaa41a2491f450705e3555925514cb6b60aa9: Status 404 returned error can't find the container with id 1133640bfc88a18d625f0cf75aeeaa41a2491f450705e3555925514cb6b60aa9 Jun 03 23:34:13.254494 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:13.254463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" event={"ID":"f0ec0619-1e89-46e0-91e9-28ec0496ee1d","Type":"ContainerStarted","Data":"1133640bfc88a18d625f0cf75aeeaa41a2491f450705e3555925514cb6b60aa9"} Jun 03 23:34:13.255499 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:13.255463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" event={"ID":"6b638dea-4302-48a6-98dd-6a4a105cbc1e","Type":"ContainerStarted","Data":"fb90d8977e62c8ba1a3fbcd6e24a59a7a46122bfd58ce531c22f9981f468a82c"} Jun 03 23:34:16.273970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:16.273874 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" event={"ID":"6b638dea-4302-48a6-98dd-6a4a105cbc1e","Type":"ContainerStarted","Data":"42931e486dd2bea2a20b57590172d10b3fabcdf36afe3c26e29aac2af743b1a9"} Jun 03 23:34:16.274364 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:16.274043 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:34:16.275367 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:16.275346 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" event={"ID":"f0ec0619-1e89-46e0-91e9-28ec0496ee1d","Type":"ContainerStarted","Data":"b70d56ca2f96f145623334378c30f46b7963786ea1b905dc5f5065ab54348d23"} Jun 03 23:34:16.275495 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:16.275475 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:16.317326 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:16.317274 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" podStartSLOduration=1.140364809 podStartE2EDuration="4.317254571s" totalImagesPullingTime="3.176889762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:16.311530795 +0000 UTC m=+583.561372914" watchObservedRunningTime="2026-06-03 23:34:16.317254571 +0000 UTC m=+583.567096726" Jun 03 23:34:16.386021 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:16.385958 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" podStartSLOduration=1.2263677 podStartE2EDuration="4.38593903s" totalImagesPullingTime="3.15957133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:16.377010112 +0000 UTC m=+583.626852231" watchObservedRunningTime="2026-06-03 23:34:16.38593903 +0000 UTC m=+583.635781148" Jun 03 23:34:17.569419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.569381 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f"] Jun 03 23:34:17.604180 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.604149 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f"] Jun 03 23:34:17.604333 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.604253 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.610927 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.610904 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:34:17.613081 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.613058 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:34:17.617487 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.617460 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:34:17.707365 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.707327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.707365 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.707371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.707605 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.707405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfz6z\" (UniqueName: \"kubernetes.io/projected/58d90a0f-5b78-4c68-98b6-8770b7894547-kube-api-access-kfz6z\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.808477 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.808436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.808477 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.808475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.808740 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.808511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfz6z\" (UniqueName: \"kubernetes.io/projected/58d90a0f-5b78-4c68-98b6-8770b7894547-kube-api-access-kfz6z\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.808946 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.808927 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.809026 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.808954 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.822825 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.822746 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfz6z\" (UniqueName: \"kubernetes.io/projected/58d90a0f-5b78-4c68-98b6-8770b7894547-kube-api-access-kfz6z\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:17.914029 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:17.913986 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:18.097171 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:18.097147 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f"] Jun 03 23:34:18.098755 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:18.098723 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d90a0f_5b78_4c68_98b6_8770b7894547.slice/crio-ab09da71d265ba45672969be2ab0afa5fae16068a975a3bf497694b4420d4afa WatchSource:0}: Error finding container ab09da71d265ba45672969be2ab0afa5fae16068a975a3bf497694b4420d4afa: Status 404 returned error can't find the container with id ab09da71d265ba45672969be2ab0afa5fae16068a975a3bf497694b4420d4afa Jun 03 23:34:18.285516 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:18.285482 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" event={"ID":"58d90a0f-5b78-4c68-98b6-8770b7894547","Type":"ContainerStarted","Data":"137f0aff1ca37a1690bbaaa844881d80162b6a5383f6b9cc3c4f811c882b7f81"} Jun 03 23:34:18.285703 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:18.285541 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" event={"ID":"58d90a0f-5b78-4c68-98b6-8770b7894547","Type":"ContainerStarted","Data":"ab09da71d265ba45672969be2ab0afa5fae16068a975a3bf497694b4420d4afa"} Jun 03 23:34:19.235287 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:19.235255 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-x5wpn" Jun 03 23:34:19.237218 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:19.237194 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-s96x5" Jun 03 23:34:19.293761 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:19.293720 2568 generic.go:356] "Generic (PLEG): container finished" podID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerID="137f0aff1ca37a1690bbaaa844881d80162b6a5383f6b9cc3c4f811c882b7f81" exitCode=0 Jun 03 23:34:19.293969 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:19.293806 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" event={"ID":"58d90a0f-5b78-4c68-98b6-8770b7894547","Type":"ContainerDied","Data":"137f0aff1ca37a1690bbaaa844881d80162b6a5383f6b9cc3c4f811c882b7f81"} Jun 03 23:34:20.236400 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.236349 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fxm56"] Jun 03 23:34:20.240064 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.239986 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.243445 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.243406 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-95nlm\"" Jun 03 23:34:20.243581 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.243412 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 23:34:20.243581 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.243500 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 23:34:20.254691 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.254657 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fxm56"] Jun 03 23:34:20.329712 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.329670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ppcn\" (UniqueName: \"kubernetes.io/projected/dff06694-4b35-4160-b68a-9e002e9c1c53-kube-api-access-4ppcn\") pod \"servicemesh-operator3-57f65f65fb-fxm56\" (UID: \"dff06694-4b35-4160-b68a-9e002e9c1c53\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.330115 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.330085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dff06694-4b35-4160-b68a-9e002e9c1c53-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fxm56\" (UID: \"dff06694-4b35-4160-b68a-9e002e9c1c53\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.430760 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.430717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dff06694-4b35-4160-b68a-9e002e9c1c53-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fxm56\" (UID: \"dff06694-4b35-4160-b68a-9e002e9c1c53\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.430965 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.430805 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ppcn\" (UniqueName: \"kubernetes.io/projected/dff06694-4b35-4160-b68a-9e002e9c1c53-kube-api-access-4ppcn\") pod \"servicemesh-operator3-57f65f65fb-fxm56\" (UID: \"dff06694-4b35-4160-b68a-9e002e9c1c53\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.433586 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.433542 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dff06694-4b35-4160-b68a-9e002e9c1c53-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fxm56\" (UID: \"dff06694-4b35-4160-b68a-9e002e9c1c53\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.441478 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.441446 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ppcn\" (UniqueName: \"kubernetes.io/projected/dff06694-4b35-4160-b68a-9e002e9c1c53-kube-api-access-4ppcn\") pod \"servicemesh-operator3-57f65f65fb-fxm56\" (UID: \"dff06694-4b35-4160-b68a-9e002e9c1c53\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.572245 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.572156 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c7b778c9c-kgsfw"] Jun 03 23:34:20.573423 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.573395 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:20.574443 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.574426 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.577855 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.577824 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cx9pv\"" Jun 03 23:34:20.578211 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.578188 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 23:34:20.608762 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.608720 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c7b778c9c-kgsfw"] Jun 03 23:34:20.733403 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.733367 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqdw\" (UniqueName: \"kubernetes.io/projected/27897d15-dc0e-4b98-8604-11ad02e62ba7-kube-api-access-nrqdw\") pod \"dashboard-redirect-7c7b778c9c-kgsfw\" (UID: \"27897d15-dc0e-4b98-8604-11ad02e62ba7\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.733594 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.733489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/27897d15-dc0e-4b98-8604-11ad02e62ba7-redirect-config\") pod \"dashboard-redirect-7c7b778c9c-kgsfw\" (UID: \"27897d15-dc0e-4b98-8604-11ad02e62ba7\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.749743 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.749704 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fxm56"] Jun 03 23:34:20.753253 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:20.753214 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff06694_4b35_4160_b68a_9e002e9c1c53.slice/crio-ce900ba93e6ad16ea7f2d19ef74501da9936571ab9fdc4926ea5783696aea321 WatchSource:0}: Error finding container ce900ba93e6ad16ea7f2d19ef74501da9936571ab9fdc4926ea5783696aea321: Status 404 returned error can't find the container with id ce900ba93e6ad16ea7f2d19ef74501da9936571ab9fdc4926ea5783696aea321 Jun 03 23:34:20.834876 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.834753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/27897d15-dc0e-4b98-8604-11ad02e62ba7-redirect-config\") pod \"dashboard-redirect-7c7b778c9c-kgsfw\" (UID: \"27897d15-dc0e-4b98-8604-11ad02e62ba7\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.834876 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.834821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqdw\" (UniqueName: \"kubernetes.io/projected/27897d15-dc0e-4b98-8604-11ad02e62ba7-kube-api-access-nrqdw\") pod \"dashboard-redirect-7c7b778c9c-kgsfw\" (UID: \"27897d15-dc0e-4b98-8604-11ad02e62ba7\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.835608 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.835588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/27897d15-dc0e-4b98-8604-11ad02e62ba7-redirect-config\") pod \"dashboard-redirect-7c7b778c9c-kgsfw\" (UID: \"27897d15-dc0e-4b98-8604-11ad02e62ba7\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.844410 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.844374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqdw\" (UniqueName: \"kubernetes.io/projected/27897d15-dc0e-4b98-8604-11ad02e62ba7-kube-api-access-nrqdw\") pod \"dashboard-redirect-7c7b778c9c-kgsfw\" (UID: \"27897d15-dc0e-4b98-8604-11ad02e62ba7\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:20.892382 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:20.892344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" Jun 03 23:34:21.046083 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:21.046047 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c7b778c9c-kgsfw"] Jun 03 23:34:21.048680 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:21.048652 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27897d15_dc0e_4b98_8604_11ad02e62ba7.slice/crio-4f58a168eb92616c2f5a04e28d784903c619a6083dd811c18f6965a699053f42 WatchSource:0}: Error finding container 4f58a168eb92616c2f5a04e28d784903c619a6083dd811c18f6965a699053f42: Status 404 returned error can't find the container with id 4f58a168eb92616c2f5a04e28d784903c619a6083dd811c18f6965a699053f42 Jun 03 23:34:21.307417 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:21.307375 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" event={"ID":"dff06694-4b35-4160-b68a-9e002e9c1c53","Type":"ContainerStarted","Data":"ce900ba93e6ad16ea7f2d19ef74501da9936571ab9fdc4926ea5783696aea321"} Jun 03 23:34:21.308580 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:21.308558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" event={"ID":"27897d15-dc0e-4b98-8604-11ad02e62ba7","Type":"ContainerStarted","Data":"4f58a168eb92616c2f5a04e28d784903c619a6083dd811c18f6965a699053f42"} Jun 03 23:34:21.310253 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:21.310227 2568 generic.go:356] "Generic (PLEG): container finished" podID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerID="ac0ea567a658bb350f2341218b702130bbec82367e47f97476f6b3ec88071b45" exitCode=0 Jun 03 23:34:21.310362 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:21.310270 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" event={"ID":"58d90a0f-5b78-4c68-98b6-8770b7894547","Type":"ContainerDied","Data":"ac0ea567a658bb350f2341218b702130bbec82367e47f97476f6b3ec88071b45"} Jun 03 23:34:22.318535 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:22.318496 2568 generic.go:356] "Generic (PLEG): container finished" podID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerID="6310048a0ae19d07c2bcf4f161cb227e0625638410ae12220febceaa6ce75bc6" exitCode=0 Jun 03 23:34:22.318961 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:22.318571 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" event={"ID":"58d90a0f-5b78-4c68-98b6-8770b7894547","Type":"ContainerDied","Data":"6310048a0ae19d07c2bcf4f161cb227e0625638410ae12220febceaa6ce75bc6"} Jun 03 23:34:23.660206 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.660171 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:23.766960 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.766926 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfz6z\" (UniqueName: \"kubernetes.io/projected/58d90a0f-5b78-4c68-98b6-8770b7894547-kube-api-access-kfz6z\") pod \"58d90a0f-5b78-4c68-98b6-8770b7894547\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " Jun 03 23:34:23.767166 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.766997 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-util\") pod \"58d90a0f-5b78-4c68-98b6-8770b7894547\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " Jun 03 23:34:23.767166 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.767070 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-bundle\") pod \"58d90a0f-5b78-4c68-98b6-8770b7894547\" (UID: \"58d90a0f-5b78-4c68-98b6-8770b7894547\") " Jun 03 23:34:23.768995 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.768949 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-bundle" (OuterVolumeSpecName: "bundle") pod "58d90a0f-5b78-4c68-98b6-8770b7894547" (UID: "58d90a0f-5b78-4c68-98b6-8770b7894547"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:23.769731 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.769691 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d90a0f-5b78-4c68-98b6-8770b7894547-kube-api-access-kfz6z" (OuterVolumeSpecName: "kube-api-access-kfz6z") pod "58d90a0f-5b78-4c68-98b6-8770b7894547" (UID: "58d90a0f-5b78-4c68-98b6-8770b7894547"). InnerVolumeSpecName "kube-api-access-kfz6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:23.774287 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.774251 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-util" (OuterVolumeSpecName: "util") pod "58d90a0f-5b78-4c68-98b6-8770b7894547" (UID: "58d90a0f-5b78-4c68-98b6-8770b7894547"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:23.868007 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.867917 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfz6z\" (UniqueName: \"kubernetes.io/projected/58d90a0f-5b78-4c68-98b6-8770b7894547-kube-api-access-kfz6z\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:34:23.868007 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.867954 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:34:23.868007 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:23.867969 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d90a0f-5b78-4c68-98b6-8770b7894547-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:34:24.336145 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:24.336118 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" Jun 03 23:34:24.336326 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:24.336116 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kz7f" event={"ID":"58d90a0f-5b78-4c68-98b6-8770b7894547","Type":"ContainerDied","Data":"ab09da71d265ba45672969be2ab0afa5fae16068a975a3bf497694b4420d4afa"} Jun 03 23:34:24.336326 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:24.336319 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab09da71d265ba45672969be2ab0afa5fae16068a975a3bf497694b4420d4afa" Jun 03 23:34:24.340665 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:24.340621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" event={"ID":"dff06694-4b35-4160-b68a-9e002e9c1c53","Type":"ContainerStarted","Data":"5c1cc51922e2f631deac8749a40e13725b852ae4403f1bfc3edeb94887793619"} Jun 03 23:34:24.340964 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:24.340944 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:24.372753 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:24.372606 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" podStartSLOduration=1.448448536 podStartE2EDuration="4.372580894s" totalImagesPullingTime="2.924132358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:24.370298093 +0000 UTC m=+591.620140213" watchObservedRunningTime="2026-06-03 23:34:24.372580894 +0000 UTC m=+591.622423014" Jun 03 23:34:28.365833 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:28.365795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" event={"ID":"27897d15-dc0e-4b98-8604-11ad02e62ba7","Type":"ContainerStarted","Data":"b31c7a6e2ab2661eaa2284586c8a5474532bf3d7682fccf2ee759b3e1b645c72"} Jun 03 23:34:28.384310 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:28.384256 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c7b778c9c-kgsfw" podStartSLOduration=1.4175128080000001 podStartE2EDuration="8.38424198s" totalImagesPullingTime="6.966729172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:28.383238989 +0000 UTC m=+595.633081145" watchObservedRunningTime="2026-06-03 23:34:28.38424198 +0000 UTC m=+595.634084097" Jun 03 23:34:33.939829 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.939737 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr"] Jun 03 23:34:33.941057 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941025 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="util" Jun 03 23:34:33.941201 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941191 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="util" Jun 03 23:34:33.941274 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941266 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="pull" Jun 03 23:34:33.941333 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941325 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="pull" Jun 03 23:34:33.941422 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941414 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="extract" Jun 03 23:34:33.941481 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941474 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="extract" Jun 03 23:34:33.941702 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.941691 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d90a0f-5b78-4c68-98b6-8770b7894547" containerName="extract" Jun 03 23:34:33.947323 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.947293 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.950288 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.950255 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 23:34:33.950448 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.950304 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 23:34:33.950448 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.950411 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 23:34:33.950448 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.950422 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 23:34:33.950790 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.950774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2hkwx\"" Jun 03 23:34:33.957644 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xct69\" (UniqueName: \"kubernetes.io/projected/1d2660f2-5a7d-4732-9c1f-b502de1ac508-kube-api-access-xct69\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.957780 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.957780 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.957780 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.957780 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.957941 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2660f2-5a7d-4732-9c1f-b502de1ac508-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.957941 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.957864 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:33.965340 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:33.965307 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr"] Jun 03 23:34:34.058271 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058231 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.058271 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.058545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2660f2-5a7d-4732-9c1f-b502de1ac508-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.058545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.058545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xct69\" (UniqueName: \"kubernetes.io/projected/1d2660f2-5a7d-4732-9c1f-b502de1ac508-kube-api-access-xct69\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.058545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.058545 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.058533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.059068 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.059038 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.060718 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.060694 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2660f2-5a7d-4732-9c1f-b502de1ac508-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.060936 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.060751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.061171 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.061146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.061235 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.061198 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d2660f2-5a7d-4732-9c1f-b502de1ac508-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.073799 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.073762 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2660f2-5a7d-4732-9c1f-b502de1ac508-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.075517 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.075486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xct69\" (UniqueName: \"kubernetes.io/projected/1d2660f2-5a7d-4732-9c1f-b502de1ac508-kube-api-access-xct69\") pod \"istiod-openshift-gateway-75c67f8887-fj4pr\" (UID: \"1d2660f2-5a7d-4732-9c1f-b502de1ac508\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.257717 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.257620 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:34.406956 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:34.406924 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr"] Jun 03 23:34:34.409611 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:34:34.409577 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2660f2_5a7d_4732_9c1f_b502de1ac508.slice/crio-9ee75ff701be7aca9cdccf5b4be1f468ecffc0a09274bb17e48b472a2fcf5de8 WatchSource:0}: Error finding container 9ee75ff701be7aca9cdccf5b4be1f468ecffc0a09274bb17e48b472a2fcf5de8: Status 404 returned error can't find the container with id 9ee75ff701be7aca9cdccf5b4be1f468ecffc0a09274bb17e48b472a2fcf5de8 Jun 03 23:34:35.349633 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:35.349596 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fxm56" Jun 03 23:34:35.400686 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:35.400651 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" event={"ID":"1d2660f2-5a7d-4732-9c1f-b502de1ac508","Type":"ContainerStarted","Data":"9ee75ff701be7aca9cdccf5b4be1f468ecffc0a09274bb17e48b472a2fcf5de8"} Jun 03 23:34:37.328757 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:37.328709 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 23:34:37.329069 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:37.328791 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 23:34:38.419649 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:38.419608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" event={"ID":"1d2660f2-5a7d-4732-9c1f-b502de1ac508","Type":"ContainerStarted","Data":"dd18fc33acd06e5cc339a714e3de5bb1419e7c51da3046ab8d2dcd93a733b357"} Jun 03 23:34:38.420048 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:38.419828 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:38.421533 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:38.421506 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-fj4pr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 23:34:38.421646 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:38.421557 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" podUID="1d2660f2-5a7d-4732-9c1f-b502de1ac508" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:34:38.458534 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:38.458466 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" podStartSLOduration=2.541788681 podStartE2EDuration="5.458443441s" totalImagesPullingTime="2.91665476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:38.4570492 +0000 UTC m=+605.706891319" watchObservedRunningTime="2026-06-03 23:34:38.458443441 +0000 UTC m=+605.708285561" Jun 03 23:34:39.426032 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:39.426004 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fj4pr" Jun 03 23:34:47.282262 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:47.282225 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kq2sn" Jun 03 23:34:47.286616 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:34:47.285185 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-csdmj" Jun 03 23:35:18.056016 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.055930 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md"] Jun 03 23:35:18.093122 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.093087 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md"] Jun 03 23:35:18.093294 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.093208 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.096149 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.096124 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:35:18.096298 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.096154 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:35:18.097146 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.097125 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kzwvk\"" Jun 03 23:35:18.148864 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.148798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.149047 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.148886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ht4b\" (UniqueName: \"kubernetes.io/projected/043bbdde-c094-433d-88f0-1bfdf80b9346-kube-api-access-9ht4b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.149047 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.148977 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.250372 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.250321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.250665 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.250388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ht4b\" (UniqueName: \"kubernetes.io/projected/043bbdde-c094-433d-88f0-1bfdf80b9346-kube-api-access-9ht4b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.250665 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.250438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.250798 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.250734 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.250798 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.250786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.260250 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.260224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ht4b\" (UniqueName: \"kubernetes.io/projected/043bbdde-c094-433d-88f0-1bfdf80b9346-kube-api-access-9ht4b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.403262 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.403222 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:18.543227 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.543195 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md"] Jun 03 23:35:18.545115 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:18.545084 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043bbdde_c094_433d_88f0_1bfdf80b9346.slice/crio-55967f16a7ba520ffca77a4d83bee3053d72b5b9d21d7293f202b84439c74a51 WatchSource:0}: Error finding container 55967f16a7ba520ffca77a4d83bee3053d72b5b9d21d7293f202b84439c74a51: Status 404 returned error can't find the container with id 55967f16a7ba520ffca77a4d83bee3053d72b5b9d21d7293f202b84439c74a51 Jun 03 23:35:18.617276 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.617233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" event={"ID":"043bbdde-c094-433d-88f0-1bfdf80b9346","Type":"ContainerStarted","Data":"73c91ad9b4f43a411ea69ebedf86a7ee07889fca4196c2db9b90e7cb13f90d12"} Jun 03 23:35:18.617432 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.617326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" event={"ID":"043bbdde-c094-433d-88f0-1bfdf80b9346","Type":"ContainerStarted","Data":"55967f16a7ba520ffca77a4d83bee3053d72b5b9d21d7293f202b84439c74a51"} Jun 03 23:35:18.859579 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.859545 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8"] Jun 03 23:35:18.862972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.862952 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:18.873785 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.873755 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8"] Jun 03 23:35:18.957726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.957633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:18.957726 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.957680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjx6k\" (UniqueName: \"kubernetes.io/projected/9f22e844-7052-4695-bddf-c68ade830bd6-kube-api-access-jjx6k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:18.957962 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:18.957730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.058889 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.058828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.058889 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.058896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjx6k\" (UniqueName: \"kubernetes.io/projected/9f22e844-7052-4695-bddf-c68ade830bd6-kube-api-access-jjx6k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.059322 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.058927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.059322 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.059268 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.059322 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.059280 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.070071 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.070033 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjx6k\" (UniqueName: \"kubernetes.io/projected/9f22e844-7052-4695-bddf-c68ade830bd6-kube-api-access-jjx6k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.172986 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.172946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:19.315956 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.315929 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8"] Jun 03 23:35:19.317114 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:19.317086 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f22e844_7052_4695_bddf_c68ade830bd6.slice/crio-01741fdd8653fadec1663157a61cae9245ca2c4a4c6089e8148c74bbcbfc38f8 WatchSource:0}: Error finding container 01741fdd8653fadec1663157a61cae9245ca2c4a4c6089e8148c74bbcbfc38f8: Status 404 returned error can't find the container with id 01741fdd8653fadec1663157a61cae9245ca2c4a4c6089e8148c74bbcbfc38f8 Jun 03 23:35:19.594021 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.593985 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks"] Jun 03 23:35:19.597503 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.597483 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.611427 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.611397 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks"] Jun 03 23:35:19.624624 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.624586 2568 generic.go:356] "Generic (PLEG): container finished" podID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerID="73c91ad9b4f43a411ea69ebedf86a7ee07889fca4196c2db9b90e7cb13f90d12" exitCode=0 Jun 03 23:35:19.624802 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.624632 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" event={"ID":"043bbdde-c094-433d-88f0-1bfdf80b9346","Type":"ContainerDied","Data":"73c91ad9b4f43a411ea69ebedf86a7ee07889fca4196c2db9b90e7cb13f90d12"} Jun 03 23:35:19.626408 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.626384 2568 generic.go:356] "Generic (PLEG): container finished" podID="9f22e844-7052-4695-bddf-c68ade830bd6" containerID="4cf51492af3b01920cdd7aa89a7f7fe44c9141523b7caaad6dbc6a9986ad9ec0" exitCode=0 Jun 03 23:35:19.626507 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.626445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" event={"ID":"9f22e844-7052-4695-bddf-c68ade830bd6","Type":"ContainerDied","Data":"4cf51492af3b01920cdd7aa89a7f7fe44c9141523b7caaad6dbc6a9986ad9ec0"} Jun 03 23:35:19.626507 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.626484 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" event={"ID":"9f22e844-7052-4695-bddf-c68ade830bd6","Type":"ContainerStarted","Data":"01741fdd8653fadec1663157a61cae9245ca2c4a4c6089e8148c74bbcbfc38f8"} Jun 03 23:35:19.664658 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.664621 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.664831 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.664672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n58tl\" (UniqueName: \"kubernetes.io/projected/f697e6da-fe49-47f6-8648-768e1e77c248-kube-api-access-n58tl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.664831 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.664711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.765684 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.765647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.765897 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.765692 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n58tl\" (UniqueName: \"kubernetes.io/projected/f697e6da-fe49-47f6-8648-768e1e77c248-kube-api-access-n58tl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.765897 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.765713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.766087 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.766070 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.766130 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.766084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.774519 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.774489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n58tl\" (UniqueName: \"kubernetes.io/projected/f697e6da-fe49-47f6-8648-768e1e77c248-kube-api-access-n58tl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.853252 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.853165 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6"] Jun 03 23:35:19.856808 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.856790 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:19.868079 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.867398 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6"] Jun 03 23:35:19.906632 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.906599 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:19.967274 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.967246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:19.967440 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.967332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:19.967440 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:19.967403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjcx7\" (UniqueName: \"kubernetes.io/projected/5395ac3f-81e0-45c0-aaff-9280ea153def-kube-api-access-vjcx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.055669 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.055643 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks"] Jun 03 23:35:20.068605 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.068565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.068605 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.068601 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.069031 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.068623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjcx7\" (UniqueName: \"kubernetes.io/projected/5395ac3f-81e0-45c0-aaff-9280ea153def-kube-api-access-vjcx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.069031 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.068963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.069190 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.069068 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.080818 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.080787 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjcx7\" (UniqueName: \"kubernetes.io/projected/5395ac3f-81e0-45c0-aaff-9280ea153def-kube-api-access-vjcx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.091052 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:20.091013 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf697e6da_fe49_47f6_8648_768e1e77c248.slice/crio-67fdc20a2b4b8cdcde8b9393faecf14350941bed1b82001c3ef5c5568edbbef7 WatchSource:0}: Error finding container 67fdc20a2b4b8cdcde8b9393faecf14350941bed1b82001c3ef5c5568edbbef7: Status 404 returned error can't find the container with id 67fdc20a2b4b8cdcde8b9393faecf14350941bed1b82001c3ef5c5568edbbef7 Jun 03 23:35:20.167071 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.167029 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:20.329323 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.329263 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6"] Jun 03 23:35:20.357053 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:20.357021 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5395ac3f_81e0_45c0_aaff_9280ea153def.slice/crio-71a38b57e5f0a830d849a7f9db7c6ee70b9d4df8ac5bd784b854f9f2b4629a17 WatchSource:0}: Error finding container 71a38b57e5f0a830d849a7f9db7c6ee70b9d4df8ac5bd784b854f9f2b4629a17: Status 404 returned error can't find the container with id 71a38b57e5f0a830d849a7f9db7c6ee70b9d4df8ac5bd784b854f9f2b4629a17 Jun 03 23:35:20.633575 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.633537 2568 generic.go:356] "Generic (PLEG): container finished" podID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerID="2eaa282e73efcf1b62630c293409faa727fdac2a5e38f5e418097f388fe3570d" exitCode=0 Jun 03 23:35:20.633749 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.633622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" event={"ID":"043bbdde-c094-433d-88f0-1bfdf80b9346","Type":"ContainerDied","Data":"2eaa282e73efcf1b62630c293409faa727fdac2a5e38f5e418097f388fe3570d"} Jun 03 23:35:20.635279 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.635252 2568 generic.go:356] "Generic (PLEG): container finished" podID="f697e6da-fe49-47f6-8648-768e1e77c248" containerID="50daf9550550df08bc66c600a98c1ff448843fac81e47853fec3a25db5de75eb" exitCode=0 Jun 03 23:35:20.635406 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.635287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" event={"ID":"f697e6da-fe49-47f6-8648-768e1e77c248","Type":"ContainerDied","Data":"50daf9550550df08bc66c600a98c1ff448843fac81e47853fec3a25db5de75eb"} Jun 03 23:35:20.635406 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.635340 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" event={"ID":"f697e6da-fe49-47f6-8648-768e1e77c248","Type":"ContainerStarted","Data":"67fdc20a2b4b8cdcde8b9393faecf14350941bed1b82001c3ef5c5568edbbef7"} Jun 03 23:35:20.637198 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.637149 2568 generic.go:356] "Generic (PLEG): container finished" podID="9f22e844-7052-4695-bddf-c68ade830bd6" containerID="d5faf3a0a3300d23c813e718b1e96d08d026d18819b80bd2abb5d714ed877b22" exitCode=0 Jun 03 23:35:20.637309 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.637215 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" event={"ID":"9f22e844-7052-4695-bddf-c68ade830bd6","Type":"ContainerDied","Data":"d5faf3a0a3300d23c813e718b1e96d08d026d18819b80bd2abb5d714ed877b22"} Jun 03 23:35:20.639062 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.638967 2568 generic.go:356] "Generic (PLEG): container finished" podID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerID="e747c87d3efe10ea8df5e61a0dec2963da5ad690ddb907384123dc914cdfb0d6" exitCode=0 Jun 03 23:35:20.639062 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.639050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" event={"ID":"5395ac3f-81e0-45c0-aaff-9280ea153def","Type":"ContainerDied","Data":"e747c87d3efe10ea8df5e61a0dec2963da5ad690ddb907384123dc914cdfb0d6"} Jun 03 23:35:20.639152 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:20.639097 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" event={"ID":"5395ac3f-81e0-45c0-aaff-9280ea153def","Type":"ContainerStarted","Data":"71a38b57e5f0a830d849a7f9db7c6ee70b9d4df8ac5bd784b854f9f2b4629a17"} Jun 03 23:35:21.646328 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.646232 2568 generic.go:356] "Generic (PLEG): container finished" podID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerID="acb0e0f97d6bdd37b068a481086105097a941cd5f40f64569c03cef9b77b842c" exitCode=0 Jun 03 23:35:21.646328 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.646306 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" event={"ID":"043bbdde-c094-433d-88f0-1bfdf80b9346","Type":"ContainerDied","Data":"acb0e0f97d6bdd37b068a481086105097a941cd5f40f64569c03cef9b77b842c"} Jun 03 23:35:21.647955 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.647927 2568 generic.go:356] "Generic (PLEG): container finished" podID="f697e6da-fe49-47f6-8648-768e1e77c248" containerID="3d4bf55fcbb9bd83fc08b73e4cab709b3ff47f600495d504151fd9e810885742" exitCode=0 Jun 03 23:35:21.648067 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.648014 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" event={"ID":"f697e6da-fe49-47f6-8648-768e1e77c248","Type":"ContainerDied","Data":"3d4bf55fcbb9bd83fc08b73e4cab709b3ff47f600495d504151fd9e810885742"} Jun 03 23:35:21.650260 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.650237 2568 generic.go:356] "Generic (PLEG): container finished" podID="9f22e844-7052-4695-bddf-c68ade830bd6" containerID="983c26b4ba73d4f845fba5d30e379d56a0ee7442baa1d214958e4b5891112fb3" exitCode=0 Jun 03 23:35:21.650349 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.650297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" event={"ID":"9f22e844-7052-4695-bddf-c68ade830bd6","Type":"ContainerDied","Data":"983c26b4ba73d4f845fba5d30e379d56a0ee7442baa1d214958e4b5891112fb3"} Jun 03 23:35:21.651980 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.651960 2568 generic.go:356] "Generic (PLEG): container finished" podID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerID="c673b37109085e7579b765ad9422399aec41f3d1790f34d8b3e5d489c2d4b8f4" exitCode=0 Jun 03 23:35:21.652058 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:21.652036 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" event={"ID":"5395ac3f-81e0-45c0-aaff-9280ea153def","Type":"ContainerDied","Data":"c673b37109085e7579b765ad9422399aec41f3d1790f34d8b3e5d489c2d4b8f4"} Jun 03 23:35:22.659237 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.659205 2568 generic.go:356] "Generic (PLEG): container finished" podID="f697e6da-fe49-47f6-8648-768e1e77c248" containerID="b267cb04edf4905071a06eb3a89035b616071dc53b2df99e61bf9fd489a89a98" exitCode=0 Jun 03 23:35:22.659699 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.659290 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" event={"ID":"f697e6da-fe49-47f6-8648-768e1e77c248","Type":"ContainerDied","Data":"b267cb04edf4905071a06eb3a89035b616071dc53b2df99e61bf9fd489a89a98"} Jun 03 23:35:22.661315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.661295 2568 generic.go:356] "Generic (PLEG): container finished" podID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerID="41d84ff05f80ec2fca957781560ebb4aec5ef3d1696ae796c6e65ca61fb42430" exitCode=0 Jun 03 23:35:22.661420 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.661369 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" event={"ID":"5395ac3f-81e0-45c0-aaff-9280ea153def","Type":"ContainerDied","Data":"41d84ff05f80ec2fca957781560ebb4aec5ef3d1696ae796c6e65ca61fb42430"} Jun 03 23:35:22.846307 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.846280 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:22.849180 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.849156 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:22.892722 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.892692 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ht4b\" (UniqueName: \"kubernetes.io/projected/043bbdde-c094-433d-88f0-1bfdf80b9346-kube-api-access-9ht4b\") pod \"043bbdde-c094-433d-88f0-1bfdf80b9346\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " Jun 03 23:35:22.892722 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.892733 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-util\") pod \"043bbdde-c094-433d-88f0-1bfdf80b9346\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " Jun 03 23:35:22.892987 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.892762 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-bundle\") pod \"043bbdde-c094-433d-88f0-1bfdf80b9346\" (UID: \"043bbdde-c094-433d-88f0-1bfdf80b9346\") " Jun 03 23:35:22.892987 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.892797 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-util\") pod \"9f22e844-7052-4695-bddf-c68ade830bd6\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " Jun 03 23:35:22.892987 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.892824 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjx6k\" (UniqueName: \"kubernetes.io/projected/9f22e844-7052-4695-bddf-c68ade830bd6-kube-api-access-jjx6k\") pod \"9f22e844-7052-4695-bddf-c68ade830bd6\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " Jun 03 23:35:22.893202 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.893181 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-bundle\") pod \"9f22e844-7052-4695-bddf-c68ade830bd6\" (UID: \"9f22e844-7052-4695-bddf-c68ade830bd6\") " Jun 03 23:35:22.893869 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.893816 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-bundle" (OuterVolumeSpecName: "bundle") pod "9f22e844-7052-4695-bddf-c68ade830bd6" (UID: "9f22e844-7052-4695-bddf-c68ade830bd6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:22.894050 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.894016 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-bundle" (OuterVolumeSpecName: "bundle") pod "043bbdde-c094-433d-88f0-1bfdf80b9346" (UID: "043bbdde-c094-433d-88f0-1bfdf80b9346"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:22.895675 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.895644 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f22e844-7052-4695-bddf-c68ade830bd6-kube-api-access-jjx6k" (OuterVolumeSpecName: "kube-api-access-jjx6k") pod "9f22e844-7052-4695-bddf-c68ade830bd6" (UID: "9f22e844-7052-4695-bddf-c68ade830bd6"). InnerVolumeSpecName "kube-api-access-jjx6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:22.895765 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.895668 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043bbdde-c094-433d-88f0-1bfdf80b9346-kube-api-access-9ht4b" (OuterVolumeSpecName: "kube-api-access-9ht4b") pod "043bbdde-c094-433d-88f0-1bfdf80b9346" (UID: "043bbdde-c094-433d-88f0-1bfdf80b9346"). InnerVolumeSpecName "kube-api-access-9ht4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:22.898624 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.898588 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-util" (OuterVolumeSpecName: "util") pod "043bbdde-c094-433d-88f0-1bfdf80b9346" (UID: "043bbdde-c094-433d-88f0-1bfdf80b9346"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:22.898859 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.898822 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-util" (OuterVolumeSpecName: "util") pod "9f22e844-7052-4695-bddf-c68ade830bd6" (UID: "9f22e844-7052-4695-bddf-c68ade830bd6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:22.995039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.994945 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ht4b\" (UniqueName: \"kubernetes.io/projected/043bbdde-c094-433d-88f0-1bfdf80b9346-kube-api-access-9ht4b\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:22.995039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.994975 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:22.995039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.994984 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043bbdde-c094-433d-88f0-1bfdf80b9346-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:22.995039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.994993 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:22.995039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.995000 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjx6k\" (UniqueName: \"kubernetes.io/projected/9f22e844-7052-4695-bddf-c68ade830bd6-kube-api-access-jjx6k\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:22.995039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:22.995009 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f22e844-7052-4695-bddf-c68ade830bd6-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:23.667734 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.667708 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" Jun 03 23:35:23.668242 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.667741 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md" event={"ID":"043bbdde-c094-433d-88f0-1bfdf80b9346","Type":"ContainerDied","Data":"55967f16a7ba520ffca77a4d83bee3053d72b5b9d21d7293f202b84439c74a51"} Jun 03 23:35:23.668242 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.667825 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55967f16a7ba520ffca77a4d83bee3053d72b5b9d21d7293f202b84439c74a51" Jun 03 23:35:23.669974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.669943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" event={"ID":"9f22e844-7052-4695-bddf-c68ade830bd6","Type":"ContainerDied","Data":"01741fdd8653fadec1663157a61cae9245ca2c4a4c6089e8148c74bbcbfc38f8"} Jun 03 23:35:23.670101 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.669983 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8" Jun 03 23:35:23.670101 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.669994 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01741fdd8653fadec1663157a61cae9245ca2c4a4c6089e8148c74bbcbfc38f8" Jun 03 23:35:23.809384 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.809356 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:23.843079 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.843054 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:23.902770 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.902733 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n58tl\" (UniqueName: \"kubernetes.io/projected/f697e6da-fe49-47f6-8648-768e1e77c248-kube-api-access-n58tl\") pod \"f697e6da-fe49-47f6-8648-768e1e77c248\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " Jun 03 23:35:23.902770 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.902768 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjcx7\" (UniqueName: \"kubernetes.io/projected/5395ac3f-81e0-45c0-aaff-9280ea153def-kube-api-access-vjcx7\") pod \"5395ac3f-81e0-45c0-aaff-9280ea153def\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " Jun 03 23:35:23.902972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.902879 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-bundle\") pod \"f697e6da-fe49-47f6-8648-768e1e77c248\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " Jun 03 23:35:23.902972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.902904 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-util\") pod \"f697e6da-fe49-47f6-8648-768e1e77c248\" (UID: \"f697e6da-fe49-47f6-8648-768e1e77c248\") " Jun 03 23:35:23.902972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.902935 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-bundle\") pod \"5395ac3f-81e0-45c0-aaff-9280ea153def\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " Jun 03 23:35:23.903144 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.902973 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-util\") pod \"5395ac3f-81e0-45c0-aaff-9280ea153def\" (UID: \"5395ac3f-81e0-45c0-aaff-9280ea153def\") " Jun 03 23:35:23.903453 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.903424 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-bundle" (OuterVolumeSpecName: "bundle") pod "5395ac3f-81e0-45c0-aaff-9280ea153def" (UID: "5395ac3f-81e0-45c0-aaff-9280ea153def"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:23.903547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.903431 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-bundle" (OuterVolumeSpecName: "bundle") pod "f697e6da-fe49-47f6-8648-768e1e77c248" (UID: "f697e6da-fe49-47f6-8648-768e1e77c248"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:23.905167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.905138 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5395ac3f-81e0-45c0-aaff-9280ea153def-kube-api-access-vjcx7" (OuterVolumeSpecName: "kube-api-access-vjcx7") pod "5395ac3f-81e0-45c0-aaff-9280ea153def" (UID: "5395ac3f-81e0-45c0-aaff-9280ea153def"). InnerVolumeSpecName "kube-api-access-vjcx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:23.905275 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.905247 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f697e6da-fe49-47f6-8648-768e1e77c248-kube-api-access-n58tl" (OuterVolumeSpecName: "kube-api-access-n58tl") pod "f697e6da-fe49-47f6-8648-768e1e77c248" (UID: "f697e6da-fe49-47f6-8648-768e1e77c248"). InnerVolumeSpecName "kube-api-access-n58tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:23.911392 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.911359 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-util" (OuterVolumeSpecName: "util") pod "5395ac3f-81e0-45c0-aaff-9280ea153def" (UID: "5395ac3f-81e0-45c0-aaff-9280ea153def"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:23.912098 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:23.912067 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-util" (OuterVolumeSpecName: "util") pod "f697e6da-fe49-47f6-8648-768e1e77c248" (UID: "f697e6da-fe49-47f6-8648-768e1e77c248"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:24.004284 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.004176 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:24.004284 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.004228 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f697e6da-fe49-47f6-8648-768e1e77c248-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:24.004284 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.004242 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:24.004284 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.004253 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5395ac3f-81e0-45c0-aaff-9280ea153def-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:24.004284 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.004262 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n58tl\" (UniqueName: \"kubernetes.io/projected/f697e6da-fe49-47f6-8648-768e1e77c248-kube-api-access-n58tl\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:24.004284 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.004272 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjcx7\" (UniqueName: \"kubernetes.io/projected/5395ac3f-81e0-45c0-aaff-9280ea153def-kube-api-access-vjcx7\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:24.676885 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.676855 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" Jun 03 23:35:24.676885 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.676869 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks" event={"ID":"f697e6da-fe49-47f6-8648-768e1e77c248","Type":"ContainerDied","Data":"67fdc20a2b4b8cdcde8b9393faecf14350941bed1b82001c3ef5c5568edbbef7"} Jun 03 23:35:24.677318 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.676927 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67fdc20a2b4b8cdcde8b9393faecf14350941bed1b82001c3ef5c5568edbbef7" Jun 03 23:35:24.679167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.679134 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" event={"ID":"5395ac3f-81e0-45c0-aaff-9280ea153def","Type":"ContainerDied","Data":"71a38b57e5f0a830d849a7f9db7c6ee70b9d4df8ac5bd784b854f9f2b4629a17"} Jun 03 23:35:24.679167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.679161 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6" Jun 03 23:35:24.679323 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:24.679176 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71a38b57e5f0a830d849a7f9db7c6ee70b9d4df8ac5bd784b854f9f2b4629a17" Jun 03 23:35:35.396575 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396539 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj"] Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396862 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396874 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396882 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="extract" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396887 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="extract" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396896 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="pull" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396902 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="pull" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396913 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="extract" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396919 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="extract" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396927 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396932 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396939 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="extract" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396943 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="extract" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396951 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396956 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396966 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396971 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="util" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396977 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="pull" Jun 03 23:35:35.396974 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396982 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="pull" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396989 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="pull" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396994 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="pull" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.396999 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="pull" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397004 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="pull" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397010 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="extract" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397015 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="extract" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397060 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5395ac3f-81e0-45c0-aaff-9280ea153def" containerName="extract" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397068 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f22e844-7052-4695-bddf-c68ade830bd6" containerName="extract" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397074 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f697e6da-fe49-47f6-8648-768e1e77c248" containerName="extract" Jun 03 23:35:35.397489 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.397080 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="043bbdde-c094-433d-88f0-1bfdf80b9346" containerName="extract" Jun 03 23:35:35.400329 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.400306 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:35.403654 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.403626 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:35:35.403814 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.403629 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 23:35:35.404529 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.404509 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jr5lb\"" Jun 03 23:35:35.404827 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.404808 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:35:35.414311 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.414279 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj"] Jun 03 23:35:35.510989 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.510943 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkb6p\" (UniqueName: \"kubernetes.io/projected/6c278178-d7eb-4dc2-b801-c4d1ca37c06e-kube-api-access-pkb6p\") pod \"dns-operator-controller-manager-864dd78c4c-pwbpj\" (UID: \"6c278178-d7eb-4dc2-b801-c4d1ca37c06e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:35.611625 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.611587 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkb6p\" (UniqueName: \"kubernetes.io/projected/6c278178-d7eb-4dc2-b801-c4d1ca37c06e-kube-api-access-pkb6p\") pod \"dns-operator-controller-manager-864dd78c4c-pwbpj\" (UID: \"6c278178-d7eb-4dc2-b801-c4d1ca37c06e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:35.620913 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.620881 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkb6p\" (UniqueName: \"kubernetes.io/projected/6c278178-d7eb-4dc2-b801-c4d1ca37c06e-kube-api-access-pkb6p\") pod \"dns-operator-controller-manager-864dd78c4c-pwbpj\" (UID: \"6c278178-d7eb-4dc2-b801-c4d1ca37c06e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:35.711858 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.711753 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:35.865092 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:35.865062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj"] Jun 03 23:35:35.866956 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:35.866915 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c278178_d7eb_4dc2_b801_c4d1ca37c06e.slice/crio-389d5c59068f96e13fc7e8559cf5ddae3f4cb162640cd4a8f34aa692a1035cf5 WatchSource:0}: Error finding container 389d5c59068f96e13fc7e8559cf5ddae3f4cb162640cd4a8f34aa692a1035cf5: Status 404 returned error can't find the container with id 389d5c59068f96e13fc7e8559cf5ddae3f4cb162640cd4a8f34aa692a1035cf5 Jun 03 23:35:36.744780 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:36.744736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" event={"ID":"6c278178-d7eb-4dc2-b801-c4d1ca37c06e","Type":"ContainerStarted","Data":"389d5c59068f96e13fc7e8559cf5ddae3f4cb162640cd4a8f34aa692a1035cf5"} Jun 03 23:35:37.757438 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:37.757327 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" event={"ID":"6c278178-d7eb-4dc2-b801-c4d1ca37c06e","Type":"ContainerStarted","Data":"844f810b25dc2afcef0c7df7874517f768ecbe1fe3047794df100593576e4d22"} Jun 03 23:35:37.757438 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:37.757433 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:37.794674 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:37.794616 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" podStartSLOduration=1.1662349810000001 podStartE2EDuration="2.794599649s" totalImagesPullingTime="1.628364668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:37.791795021 +0000 UTC m=+665.041637139" watchObservedRunningTime="2026-06-03 23:35:37.794599649 +0000 UTC m=+665.044441766" Jun 03 23:35:40.355020 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.354979 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8"] Jun 03 23:35:40.358461 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.358437 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.364220 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.364195 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2ss54\"" Jun 03 23:35:40.380754 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.380711 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8"] Jun 03 23:35:40.456238 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.456204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktn9\" (UniqueName: \"kubernetes.io/projected/2221ab71-8826-4356-b03c-1f0e8b79681b-kube-api-access-rktn9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.456407 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.456314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2221ab71-8826-4356-b03c-1f0e8b79681b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.557508 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.557465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktn9\" (UniqueName: \"kubernetes.io/projected/2221ab71-8826-4356-b03c-1f0e8b79681b-kube-api-access-rktn9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.557683 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.557555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2221ab71-8826-4356-b03c-1f0e8b79681b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.557919 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.557902 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2221ab71-8826-4356-b03c-1f0e8b79681b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.568107 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.568072 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktn9\" (UniqueName: \"kubernetes.io/projected/2221ab71-8826-4356-b03c-1f0e8b79681b-kube-api-access-rktn9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.668735 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.668629 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:40.827022 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:40.826996 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8"] Jun 03 23:35:40.828904 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:40.828820 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2221ab71_8826_4356_b03c_1f0e8b79681b.slice/crio-ffefcc4892d1bedcb2e83e4797dc5687f09b19b6e45bd0b32614c16b94bc35dc WatchSource:0}: Error finding container ffefcc4892d1bedcb2e83e4797dc5687f09b19b6e45bd0b32614c16b94bc35dc: Status 404 returned error can't find the container with id ffefcc4892d1bedcb2e83e4797dc5687f09b19b6e45bd0b32614c16b94bc35dc Jun 03 23:35:41.785537 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:41.785501 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" event={"ID":"2221ab71-8826-4356-b03c-1f0e8b79681b","Type":"ContainerStarted","Data":"ffefcc4892d1bedcb2e83e4797dc5687f09b19b6e45bd0b32614c16b94bc35dc"} Jun 03 23:35:44.804578 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:44.804539 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" event={"ID":"2221ab71-8826-4356-b03c-1f0e8b79681b","Type":"ContainerStarted","Data":"b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b"} Jun 03 23:35:44.805071 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:44.804638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:44.828423 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:44.828358 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" podStartSLOduration=1.057357755 podStartE2EDuration="4.828340666s" totalImagesPullingTime="3.770982911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:44.826415283 +0000 UTC m=+672.076257403" watchObservedRunningTime="2026-06-03 23:35:44.828340666 +0000 UTC m=+672.078182785" Jun 03 23:35:48.764928 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:48.764896 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pwbpj" Jun 03 23:35:55.812937 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:55.812898 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.538503 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.538466 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8"] Jun 03 23:35:57.538957 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.538670 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" containerName="manager" containerID="cri-o://b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b" gracePeriod=2 Jun 03 23:35:57.543051 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.543020 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8"] Jun 03 23:35:57.547975 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.547933 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.576081 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.576047 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp"] Jun 03 23:35:57.576514 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.576489 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" containerName="manager" Jun 03 23:35:57.576514 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.576514 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" containerName="manager" Jun 03 23:35:57.576704 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.576624 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" containerName="manager" Jun 03 23:35:57.579582 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.579562 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.582404 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.582375 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.589929 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.589875 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl"] Jun 03 23:35:57.593930 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.593904 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.597565 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.597539 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp"] Jun 03 23:35:57.618015 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.617989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqm8h\" (UniqueName: \"kubernetes.io/projected/f3236101-53bd-4947-ac10-0e5b63e597b6-kube-api-access-sqm8h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2pggl\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.618146 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.618033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3236101-53bd-4947-ac10-0e5b63e597b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2pggl\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.618146 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.618064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816a0580-6295-448b-b235-4a43293db70f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mxjgp\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.618146 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.618096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkw7b\" (UniqueName: \"kubernetes.io/projected/816a0580-6295-448b-b235-4a43293db70f-kube-api-access-hkw7b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mxjgp\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.622552 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.622524 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl"] Jun 03 23:35:57.633681 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.633645 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.718674 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.718638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqm8h\" (UniqueName: \"kubernetes.io/projected/f3236101-53bd-4947-ac10-0e5b63e597b6-kube-api-access-sqm8h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2pggl\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.718814 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.718719 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3236101-53bd-4947-ac10-0e5b63e597b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2pggl\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.718814 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.718752 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816a0580-6295-448b-b235-4a43293db70f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mxjgp\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.718814 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.718803 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkw7b\" (UniqueName: \"kubernetes.io/projected/816a0580-6295-448b-b235-4a43293db70f-kube-api-access-hkw7b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mxjgp\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.719283 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.719260 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3236101-53bd-4947-ac10-0e5b63e597b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2pggl\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.719432 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.719391 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816a0580-6295-448b-b235-4a43293db70f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mxjgp\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.734395 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.734366 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkw7b\" (UniqueName: \"kubernetes.io/projected/816a0580-6295-448b-b235-4a43293db70f-kube-api-access-hkw7b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mxjgp\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.741621 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.741592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqm8h\" (UniqueName: \"kubernetes.io/projected/f3236101-53bd-4947-ac10-0e5b63e597b6-kube-api-access-sqm8h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2pggl\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.786736 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.786706 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.789337 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.789282 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.819552 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.819516 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2221ab71-8826-4356-b03c-1f0e8b79681b-extensions-socket-volume\") pod \"2221ab71-8826-4356-b03c-1f0e8b79681b\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " Jun 03 23:35:57.819681 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.819585 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rktn9\" (UniqueName: \"kubernetes.io/projected/2221ab71-8826-4356-b03c-1f0e8b79681b-kube-api-access-rktn9\") pod \"2221ab71-8826-4356-b03c-1f0e8b79681b\" (UID: \"2221ab71-8826-4356-b03c-1f0e8b79681b\") " Jun 03 23:35:57.820050 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.820027 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2221ab71-8826-4356-b03c-1f0e8b79681b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2221ab71-8826-4356-b03c-1f0e8b79681b" (UID: "2221ab71-8826-4356-b03c-1f0e8b79681b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:57.821614 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.821591 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2221ab71-8826-4356-b03c-1f0e8b79681b-kube-api-access-rktn9" (OuterVolumeSpecName: "kube-api-access-rktn9") pod "2221ab71-8826-4356-b03c-1f0e8b79681b" (UID: "2221ab71-8826-4356-b03c-1f0e8b79681b"). InnerVolumeSpecName "kube-api-access-rktn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:57.877685 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.877646 2568 generic.go:356] "Generic (PLEG): container finished" podID="2221ab71-8826-4356-b03c-1f0e8b79681b" containerID="b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b" exitCode=0 Jun 03 23:35:57.877878 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.877695 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.877878 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.877753 2568 scope.go:117] "RemoveContainer" containerID="b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b" Jun 03 23:35:57.880158 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.880124 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.887074 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.887057 2568 scope.go:117] "RemoveContainer" containerID="b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b" Jun 03 23:35:57.887348 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.887324 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b\": container with ID starting with b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b not found: ID does not exist" containerID="b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b" Jun 03 23:35:57.887446 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.887354 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b"} err="failed to get container status \"b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b\": rpc error: code = NotFound desc = could not find container \"b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b\": container with ID starting with b2bb5203050d41d711e1b124013fa1235f9d53594a5adde69bd58cc9696d7e1b not found: ID does not exist" Jun 03 23:35:57.888330 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:57.888308 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:57.911490 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.911451 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:57.917719 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.917702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:57.920229 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.920201 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rktn9\" (UniqueName: \"kubernetes.io/projected/2221ab71-8826-4356-b03c-1f0e8b79681b-kube-api-access-rktn9\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:57.920334 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:57.920232 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2221ab71-8826-4356-b03c-1f0e8b79681b-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:35:58.060596 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.059062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp"] Jun 03 23:35:58.062564 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:58.062534 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816a0580_6295_448b_b235_4a43293db70f.slice/crio-640ec2e5e5ea4203c6026e47a362fbba5d71f0d61248e8d027fdc8a6bcb901e0 WatchSource:0}: Error finding container 640ec2e5e5ea4203c6026e47a362fbba5d71f0d61248e8d027fdc8a6bcb901e0: Status 404 returned error can't find the container with id 640ec2e5e5ea4203c6026e47a362fbba5d71f0d61248e8d027fdc8a6bcb901e0 Jun 03 23:35:58.081379 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.081357 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl"] Jun 03 23:35:58.082688 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:35:58.082663 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3236101_53bd_4947_ac10_0e5b63e597b6.slice/crio-3d52fc6954f42e060c594c44218311ead52fec2c49019827a0175029a247e893 WatchSource:0}: Error finding container 3d52fc6954f42e060c594c44218311ead52fec2c49019827a0175029a247e893: Status 404 returned error can't find the container with id 3d52fc6954f42e060c594c44218311ead52fec2c49019827a0175029a247e893 Jun 03 23:35:58.884867 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.884811 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" event={"ID":"816a0580-6295-448b-b235-4a43293db70f","Type":"ContainerStarted","Data":"104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1"} Jun 03 23:35:58.885281 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.884986 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:35:58.885281 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.885027 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" event={"ID":"816a0580-6295-448b-b235-4a43293db70f","Type":"ContainerStarted","Data":"640ec2e5e5ea4203c6026e47a362fbba5d71f0d61248e8d027fdc8a6bcb901e0"} Jun 03 23:35:58.887306 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.887281 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" event={"ID":"f3236101-53bd-4947-ac10-0e5b63e597b6","Type":"ContainerStarted","Data":"f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e"} Jun 03 23:35:58.887439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.887320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" event={"ID":"f3236101-53bd-4947-ac10-0e5b63e597b6","Type":"ContainerStarted","Data":"3d52fc6954f42e060c594c44218311ead52fec2c49019827a0175029a247e893"} Jun 03 23:35:58.887439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.887420 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:35:58.917058 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.916996 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" podStartSLOduration=1.916979956 podStartE2EDuration="1.916979956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:58.915157402 +0000 UTC m=+686.164999520" watchObservedRunningTime="2026-06-03 23:35:58.916979956 +0000 UTC m=+686.166822074" Jun 03 23:35:58.918794 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:58.918767 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:58.921376 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:35:58.921335 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kjhx8\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kjhx8" Jun 03 23:35:58.952785 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:58.952726 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" podStartSLOduration=1.952708414 podStartE2EDuration="1.952708414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:58.951338299 +0000 UTC m=+686.201180416" watchObservedRunningTime="2026-06-03 23:35:58.952708414 +0000 UTC m=+686.202550532" Jun 03 23:35:59.226439 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:35:59.226344 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2221ab71-8826-4356-b03c-1f0e8b79681b" path="/var/lib/kubelet/pods/2221ab71-8826-4356-b03c-1f0e8b79681b/volumes" Jun 03 23:36:09.894125 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:09.894089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:36:09.894542 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:09.894376 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:36:09.995075 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:09.995041 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl"] Jun 03 23:36:09.995270 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:09.995245 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" podUID="f3236101-53bd-4947-ac10-0e5b63e597b6" containerName="manager" containerID="cri-o://f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e" gracePeriod=10 Jun 03 23:36:10.244816 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.244791 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:36:10.324519 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.324483 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln"] Jun 03 23:36:10.324811 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.324799 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3236101-53bd-4947-ac10-0e5b63e597b6" containerName="manager" Jun 03 23:36:10.324876 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.324812 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3236101-53bd-4947-ac10-0e5b63e597b6" containerName="manager" Jun 03 23:36:10.324925 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.324880 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3236101-53bd-4947-ac10-0e5b63e597b6" containerName="manager" Jun 03 23:36:10.328322 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.328306 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.330530 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.330510 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3236101-53bd-4947-ac10-0e5b63e597b6-extensions-socket-volume\") pod \"f3236101-53bd-4947-ac10-0e5b63e597b6\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " Jun 03 23:36:10.330646 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.330605 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqm8h\" (UniqueName: \"kubernetes.io/projected/f3236101-53bd-4947-ac10-0e5b63e597b6-kube-api-access-sqm8h\") pod \"f3236101-53bd-4947-ac10-0e5b63e597b6\" (UID: \"f3236101-53bd-4947-ac10-0e5b63e597b6\") " Jun 03 23:36:10.330919 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.330893 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3236101-53bd-4947-ac10-0e5b63e597b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3236101-53bd-4947-ac10-0e5b63e597b6" (UID: "f3236101-53bd-4947-ac10-0e5b63e597b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:36:10.333096 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.333078 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3236101-53bd-4947-ac10-0e5b63e597b6-kube-api-access-sqm8h" (OuterVolumeSpecName: "kube-api-access-sqm8h") pod "f3236101-53bd-4947-ac10-0e5b63e597b6" (UID: "f3236101-53bd-4947-ac10-0e5b63e597b6"). InnerVolumeSpecName "kube-api-access-sqm8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:36:10.351348 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.351320 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln"] Jun 03 23:36:10.431339 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.431245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deac38f4-f612-485d-b2d6-11cc1198cf32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bv4ln\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.431339 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.431317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjtq\" (UniqueName: \"kubernetes.io/projected/deac38f4-f612-485d-b2d6-11cc1198cf32-kube-api-access-lzjtq\") pod \"kuadrant-operator-controller-manager-86878c769f-bv4ln\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.431547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.431403 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqm8h\" (UniqueName: \"kubernetes.io/projected/f3236101-53bd-4947-ac10-0e5b63e597b6-kube-api-access-sqm8h\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:36:10.431547 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.431428 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3236101-53bd-4947-ac10-0e5b63e597b6-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:36:10.532132 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.532092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deac38f4-f612-485d-b2d6-11cc1198cf32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bv4ln\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.532300 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.532190 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjtq\" (UniqueName: \"kubernetes.io/projected/deac38f4-f612-485d-b2d6-11cc1198cf32-kube-api-access-lzjtq\") pod \"kuadrant-operator-controller-manager-86878c769f-bv4ln\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.532467 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.532446 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deac38f4-f612-485d-b2d6-11cc1198cf32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bv4ln\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.552593 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.552560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjtq\" (UniqueName: \"kubernetes.io/projected/deac38f4-f612-485d-b2d6-11cc1198cf32-kube-api-access-lzjtq\") pod \"kuadrant-operator-controller-manager-86878c769f-bv4ln\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.645290 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.645250 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.789255 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.786386 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln"] Jun 03 23:36:10.789255 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:36:10.787306 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeac38f4_f612_485d_b2d6_11cc1198cf32.slice/crio-781b0e519e9b1c20f74286b2ae7bf66477a172c8405dba32acd62906ce3eb087 WatchSource:0}: Error finding container 781b0e519e9b1c20f74286b2ae7bf66477a172c8405dba32acd62906ce3eb087: Status 404 returned error can't find the container with id 781b0e519e9b1c20f74286b2ae7bf66477a172c8405dba32acd62906ce3eb087 Jun 03 23:36:10.953970 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.953878 2568 generic.go:356] "Generic (PLEG): container finished" podID="f3236101-53bd-4947-ac10-0e5b63e597b6" containerID="f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e" exitCode=0 Jun 03 23:36:10.954380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.953975 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" Jun 03 23:36:10.954380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.954004 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" event={"ID":"f3236101-53bd-4947-ac10-0e5b63e597b6","Type":"ContainerDied","Data":"f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e"} Jun 03 23:36:10.954380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.954059 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl" event={"ID":"f3236101-53bd-4947-ac10-0e5b63e597b6","Type":"ContainerDied","Data":"3d52fc6954f42e060c594c44218311ead52fec2c49019827a0175029a247e893"} Jun 03 23:36:10.954380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.954084 2568 scope.go:117] "RemoveContainer" containerID="f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e" Jun 03 23:36:10.955713 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.955690 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" event={"ID":"deac38f4-f612-485d-b2d6-11cc1198cf32","Type":"ContainerStarted","Data":"d532e19117f65a48a65d77d243178af937092734076f16ac70c5496293f326a1"} Jun 03 23:36:10.955805 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.955738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" event={"ID":"deac38f4-f612-485d-b2d6-11cc1198cf32","Type":"ContainerStarted","Data":"781b0e519e9b1c20f74286b2ae7bf66477a172c8405dba32acd62906ce3eb087"} Jun 03 23:36:10.955805 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.955769 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:10.964039 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.964019 2568 scope.go:117] "RemoveContainer" containerID="f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e" Jun 03 23:36:10.964271 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:36:10.964251 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e\": container with ID starting with f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e not found: ID does not exist" containerID="f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e" Jun 03 23:36:10.964315 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.964278 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e"} err="failed to get container status \"f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e\": rpc error: code = NotFound desc = could not find container \"f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e\": container with ID starting with f292f2080104885bb0252be64c0ab4bbda4064f290ae8ba55db96cca248efd2e not found: ID does not exist" Jun 03 23:36:10.981912 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.981866 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" podStartSLOduration=0.9818244 podStartE2EDuration="981.8244ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:10.980668812 +0000 UTC m=+698.230510932" watchObservedRunningTime="2026-06-03 23:36:10.9818244 +0000 UTC m=+698.231666518" Jun 03 23:36:10.995760 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:10.995732 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl"] Jun 03 23:36:11.003427 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:11.003404 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2pggl"] Jun 03 23:36:11.225703 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:11.225611 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3236101-53bd-4947-ac10-0e5b63e597b6" path="/var/lib/kubelet/pods/f3236101-53bd-4947-ac10-0e5b63e597b6/volumes" Jun 03 23:36:21.964499 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:21.964461 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:36:22.072516 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.072471 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp"] Jun 03 23:36:22.072765 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.072740 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" podUID="816a0580-6295-448b-b235-4a43293db70f" containerName="manager" containerID="cri-o://104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1" gracePeriod=10 Jun 03 23:36:22.325722 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.325698 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:36:22.434594 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.434559 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816a0580-6295-448b-b235-4a43293db70f-extensions-socket-volume\") pod \"816a0580-6295-448b-b235-4a43293db70f\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " Jun 03 23:36:22.434771 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.434620 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkw7b\" (UniqueName: \"kubernetes.io/projected/816a0580-6295-448b-b235-4a43293db70f-kube-api-access-hkw7b\") pod \"816a0580-6295-448b-b235-4a43293db70f\" (UID: \"816a0580-6295-448b-b235-4a43293db70f\") " Jun 03 23:36:22.434996 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.434976 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816a0580-6295-448b-b235-4a43293db70f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "816a0580-6295-448b-b235-4a43293db70f" (UID: "816a0580-6295-448b-b235-4a43293db70f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:36:22.436669 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.436641 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816a0580-6295-448b-b235-4a43293db70f-kube-api-access-hkw7b" (OuterVolumeSpecName: "kube-api-access-hkw7b") pod "816a0580-6295-448b-b235-4a43293db70f" (UID: "816a0580-6295-448b-b235-4a43293db70f"). InnerVolumeSpecName "kube-api-access-hkw7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:36:22.536278 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.536159 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816a0580-6295-448b-b235-4a43293db70f-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:36:22.536278 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:22.536191 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkw7b\" (UniqueName: \"kubernetes.io/projected/816a0580-6295-448b-b235-4a43293db70f-kube-api-access-hkw7b\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:36:23.030279 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.030246 2568 generic.go:356] "Generic (PLEG): container finished" podID="816a0580-6295-448b-b235-4a43293db70f" containerID="104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1" exitCode=0 Jun 03 23:36:23.030694 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.030291 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" Jun 03 23:36:23.030694 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.030289 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" event={"ID":"816a0580-6295-448b-b235-4a43293db70f","Type":"ContainerDied","Data":"104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1"} Jun 03 23:36:23.030694 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.030345 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp" event={"ID":"816a0580-6295-448b-b235-4a43293db70f","Type":"ContainerDied","Data":"640ec2e5e5ea4203c6026e47a362fbba5d71f0d61248e8d027fdc8a6bcb901e0"} Jun 03 23:36:23.030694 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.030368 2568 scope.go:117] "RemoveContainer" containerID="104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1" Jun 03 23:36:23.040529 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.040510 2568 scope.go:117] "RemoveContainer" containerID="104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1" Jun 03 23:36:23.040810 ip-10-0-138-87 kubenswrapper[2568]: E0603 23:36:23.040791 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1\": container with ID starting with 104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1 not found: ID does not exist" containerID="104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1" Jun 03 23:36:23.040886 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.040819 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1"} err="failed to get container status \"104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1\": rpc error: code = NotFound desc = could not find container \"104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1\": container with ID starting with 104e537291b1b76bf457ad395edc30dbe6d0ca7756a5d515638f103ccd3441c1 not found: ID does not exist" Jun 03 23:36:23.056755 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.056721 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp"] Jun 03 23:36:23.061524 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.061500 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mxjgp"] Jun 03 23:36:23.224191 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:23.224159 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816a0580-6295-448b-b235-4a43293db70f" path="/var/lib/kubelet/pods/816a0580-6295-448b-b235-4a43293db70f/volumes" Jun 03 23:36:40.993386 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:40.993345 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:40.993767 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:40.993666 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816a0580-6295-448b-b235-4a43293db70f" containerName="manager" Jun 03 23:36:40.993767 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:40.993677 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="816a0580-6295-448b-b235-4a43293db70f" containerName="manager" Jun 03 23:36:40.993767 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:40.993749 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="816a0580-6295-448b-b235-4a43293db70f" containerName="manager" Jun 03 23:36:40.998048 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:40.998029 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.000892 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.000869 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 23:36:41.000999 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.000926 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kzwvk\"" Jun 03 23:36:41.007890 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.007863 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:41.087882 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.087835 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:41.094642 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.094609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f133593-3304-4c2b-b93f-8421640d0121-config-file\") pod \"limitador-limitador-64c94fd64f-rzmgk\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.094784 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.094655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v55wp\" (UniqueName: \"kubernetes.io/projected/8f133593-3304-4c2b-b93f-8421640d0121-kube-api-access-v55wp\") pod \"limitador-limitador-64c94fd64f-rzmgk\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.195938 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.195907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f133593-3304-4c2b-b93f-8421640d0121-config-file\") pod \"limitador-limitador-64c94fd64f-rzmgk\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.196128 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.195947 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v55wp\" (UniqueName: \"kubernetes.io/projected/8f133593-3304-4c2b-b93f-8421640d0121-kube-api-access-v55wp\") pod \"limitador-limitador-64c94fd64f-rzmgk\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.196560 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.196537 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f133593-3304-4c2b-b93f-8421640d0121-config-file\") pod \"limitador-limitador-64c94fd64f-rzmgk\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.204553 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.204525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v55wp\" (UniqueName: \"kubernetes.io/projected/8f133593-3304-4c2b-b93f-8421640d0121-kube-api-access-v55wp\") pod \"limitador-limitador-64c94fd64f-rzmgk\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.309651 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.309543 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:41.443252 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:41.443222 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:41.445069 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:36:41.445031 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f133593_3304_4c2b_b93f_8421640d0121.slice/crio-8b2fb1293db29d009ec6c1efa0d5b7a015ee9d7b4de3e6f363000fb9a670aa04 WatchSource:0}: Error finding container 8b2fb1293db29d009ec6c1efa0d5b7a015ee9d7b4de3e6f363000fb9a670aa04: Status 404 returned error can't find the container with id 8b2fb1293db29d009ec6c1efa0d5b7a015ee9d7b4de3e6f363000fb9a670aa04 Jun 03 23:36:42.134456 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:42.134372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" event={"ID":"8f133593-3304-4c2b-b93f-8421640d0121","Type":"ContainerStarted","Data":"8b2fb1293db29d009ec6c1efa0d5b7a015ee9d7b4de3e6f363000fb9a670aa04"} Jun 03 23:36:44.151184 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:44.151142 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" event={"ID":"8f133593-3304-4c2b-b93f-8421640d0121","Type":"ContainerStarted","Data":"f171c36cc2284346c8a7796b7a909b53159b0fea7cd132a53fd9f9482f50d824"} Jun 03 23:36:44.151600 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:44.151230 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:44.169818 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:44.169731 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" podStartSLOduration=1.711533642 podStartE2EDuration="4.169716113s" totalImagesPullingTime="2.458182471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:44.166922496 +0000 UTC m=+731.416764616" watchObservedRunningTime="2026-06-03 23:36:44.169716113 +0000 UTC m=+731.419558230" Jun 03 23:36:55.159098 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:55.159068 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:55.800351 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:55.800314 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:55.800543 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:55.800512 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" podUID="8f133593-3304-4c2b-b93f-8421640d0121" containerName="limitador" containerID="cri-o://f171c36cc2284346c8a7796b7a909b53159b0fea7cd132a53fd9f9482f50d824" gracePeriod=30 Jun 03 23:36:56.215584 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.215553 2568 generic.go:356] "Generic (PLEG): container finished" podID="8f133593-3304-4c2b-b93f-8421640d0121" containerID="f171c36cc2284346c8a7796b7a909b53159b0fea7cd132a53fd9f9482f50d824" exitCode=0 Jun 03 23:36:56.215976 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.215590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" event={"ID":"8f133593-3304-4c2b-b93f-8421640d0121","Type":"ContainerDied","Data":"f171c36cc2284346c8a7796b7a909b53159b0fea7cd132a53fd9f9482f50d824"} Jun 03 23:36:56.747425 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.747396 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:56.818234 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.818200 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f133593-3304-4c2b-b93f-8421640d0121-config-file\") pod \"8f133593-3304-4c2b-b93f-8421640d0121\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " Jun 03 23:36:56.818397 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.818261 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v55wp\" (UniqueName: \"kubernetes.io/projected/8f133593-3304-4c2b-b93f-8421640d0121-kube-api-access-v55wp\") pod \"8f133593-3304-4c2b-b93f-8421640d0121\" (UID: \"8f133593-3304-4c2b-b93f-8421640d0121\") " Jun 03 23:36:56.818602 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.818577 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f133593-3304-4c2b-b93f-8421640d0121-config-file" (OuterVolumeSpecName: "config-file") pod "8f133593-3304-4c2b-b93f-8421640d0121" (UID: "8f133593-3304-4c2b-b93f-8421640d0121"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:36:56.820300 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.820275 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f133593-3304-4c2b-b93f-8421640d0121-kube-api-access-v55wp" (OuterVolumeSpecName: "kube-api-access-v55wp") pod "8f133593-3304-4c2b-b93f-8421640d0121" (UID: "8f133593-3304-4c2b-b93f-8421640d0121"). InnerVolumeSpecName "kube-api-access-v55wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:36:56.919424 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.919334 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v55wp\" (UniqueName: \"kubernetes.io/projected/8f133593-3304-4c2b-b93f-8421640d0121-kube-api-access-v55wp\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:36:56.919424 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:56.919424 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f133593-3304-4c2b-b93f-8421640d0121-config-file\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:36:57.222451 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:57.222376 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" Jun 03 23:36:57.223504 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:57.223482 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rzmgk" event={"ID":"8f133593-3304-4c2b-b93f-8421640d0121","Type":"ContainerDied","Data":"8b2fb1293db29d009ec6c1efa0d5b7a015ee9d7b4de3e6f363000fb9a670aa04"} Jun 03 23:36:57.223580 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:57.223529 2568 scope.go:117] "RemoveContainer" containerID="f171c36cc2284346c8a7796b7a909b53159b0fea7cd132a53fd9f9482f50d824" Jun 03 23:36:57.245718 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:57.245689 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:57.248712 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:57.248687 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rzmgk"] Jun 03 23:36:59.225856 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:36:59.225800 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f133593-3304-4c2b-b93f-8421640d0121" path="/var/lib/kubelet/pods/8f133593-3304-4c2b-b93f-8421640d0121/volumes" Jun 03 23:37:01.917876 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.917826 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vw4hm"] Jun 03 23:37:01.918425 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.918260 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f133593-3304-4c2b-b93f-8421640d0121" containerName="limitador" Jun 03 23:37:01.918425 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.918274 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f133593-3304-4c2b-b93f-8421640d0121" containerName="limitador" Jun 03 23:37:01.918425 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.918337 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f133593-3304-4c2b-b93f-8421640d0121" containerName="limitador" Jun 03 23:37:01.922698 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.922678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:01.925137 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.925119 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 23:37:01.931124 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.931101 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vw4hm"] Jun 03 23:37:01.964664 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.964634 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fc329a9-53f5-48f2-9ef3-e85f7cb47583-data\") pod \"postgres-69fb4594cf-vw4hm\" (UID: \"4fc329a9-53f5-48f2-9ef3-e85f7cb47583\") " pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:01.964824 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:01.964703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnng6\" (UniqueName: \"kubernetes.io/projected/4fc329a9-53f5-48f2-9ef3-e85f7cb47583-kube-api-access-xnng6\") pod \"postgres-69fb4594cf-vw4hm\" (UID: \"4fc329a9-53f5-48f2-9ef3-e85f7cb47583\") " pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:02.065514 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:02.065475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fc329a9-53f5-48f2-9ef3-e85f7cb47583-data\") pod \"postgres-69fb4594cf-vw4hm\" (UID: \"4fc329a9-53f5-48f2-9ef3-e85f7cb47583\") " pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:02.065681 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:02.065636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnng6\" (UniqueName: \"kubernetes.io/projected/4fc329a9-53f5-48f2-9ef3-e85f7cb47583-kube-api-access-xnng6\") pod \"postgres-69fb4594cf-vw4hm\" (UID: \"4fc329a9-53f5-48f2-9ef3-e85f7cb47583\") " pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:02.065981 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:02.065882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fc329a9-53f5-48f2-9ef3-e85f7cb47583-data\") pod \"postgres-69fb4594cf-vw4hm\" (UID: \"4fc329a9-53f5-48f2-9ef3-e85f7cb47583\") " pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:02.074363 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:02.074335 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnng6\" (UniqueName: \"kubernetes.io/projected/4fc329a9-53f5-48f2-9ef3-e85f7cb47583-kube-api-access-xnng6\") pod \"postgres-69fb4594cf-vw4hm\" (UID: \"4fc329a9-53f5-48f2-9ef3-e85f7cb47583\") " pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:02.234345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:02.234256 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:02.376667 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:02.376637 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vw4hm"] Jun 03 23:37:02.379054 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:37:02.379025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc329a9_53f5_48f2_9ef3_e85f7cb47583.slice/crio-7693e65cd31daef4c0cd86ef3dd888fedf7b31f7b3ce37cb162ced48d7aa90d8 WatchSource:0}: Error finding container 7693e65cd31daef4c0cd86ef3dd888fedf7b31f7b3ce37cb162ced48d7aa90d8: Status 404 returned error can't find the container with id 7693e65cd31daef4c0cd86ef3dd888fedf7b31f7b3ce37cb162ced48d7aa90d8 Jun 03 23:37:03.259856 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:03.259804 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vw4hm" event={"ID":"4fc329a9-53f5-48f2-9ef3-e85f7cb47583","Type":"ContainerStarted","Data":"7693e65cd31daef4c0cd86ef3dd888fedf7b31f7b3ce37cb162ced48d7aa90d8"} Jun 03 23:37:05.272667 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:05.272634 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vw4hm" event={"ID":"4fc329a9-53f5-48f2-9ef3-e85f7cb47583","Type":"ContainerStarted","Data":"9dd70106f0827489dadfa5f32e6c50e6c8c179eee82266f685470c688951da7d"} Jun 03 23:37:05.273059 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:05.272701 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:05.292672 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:05.292623 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vw4hm" podStartSLOduration=1.98395908 podStartE2EDuration="4.292607774s" totalImagesPullingTime="2.308648694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:05.290915427 +0000 UTC m=+752.540757546" watchObservedRunningTime="2026-06-03 23:37:05.292607774 +0000 UTC m=+752.542449891" Jun 03 23:37:11.309026 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:11.308996 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vw4hm" Jun 03 23:37:12.886571 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.886536 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9"] Jun 03 23:37:12.891322 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.891305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:12.894144 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.894120 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:37:12.894283 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.894210 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:37:12.894371 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.894356 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sz27\"" Jun 03 23:37:12.899732 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.899696 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9"] Jun 03 23:37:12.960361 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.960326 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:12.960567 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.960415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68mgr\" (UniqueName: \"kubernetes.io/projected/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-kube-api-access-68mgr\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:12.960567 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:12.960453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.061411 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.061376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.061610 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.061465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68mgr\" (UniqueName: \"kubernetes.io/projected/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-kube-api-access-68mgr\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.061610 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.061506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.061835 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.061811 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.061835 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.061830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.070990 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.070965 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68mgr\" (UniqueName: \"kubernetes.io/projected/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-kube-api-access-68mgr\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.201599 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.201507 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:13.338360 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:13.338334 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9"] Jun 03 23:37:13.340182 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:37:13.340155 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffe531c_e49e_44c7_a0e6_8e52ee7882c7.slice/crio-04a3a77b54df5d50206c3059053ed71be5d72f39038e065b259c63da1cb1ec6f WatchSource:0}: Error finding container 04a3a77b54df5d50206c3059053ed71be5d72f39038e065b259c63da1cb1ec6f: Status 404 returned error can't find the container with id 04a3a77b54df5d50206c3059053ed71be5d72f39038e065b259c63da1cb1ec6f Jun 03 23:37:14.324598 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:14.324558 2568 generic.go:356] "Generic (PLEG): container finished" podID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerID="d534ddd01de70dc3664ca61473eba0d26e064dc718db5d62badf71768b504fa5" exitCode=0 Jun 03 23:37:14.325008 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:14.324646 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" event={"ID":"cffe531c-e49e-44c7-a0e6-8e52ee7882c7","Type":"ContainerDied","Data":"d534ddd01de70dc3664ca61473eba0d26e064dc718db5d62badf71768b504fa5"} Jun 03 23:37:14.325008 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:14.324700 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" event={"ID":"cffe531c-e49e-44c7-a0e6-8e52ee7882c7","Type":"ContainerStarted","Data":"04a3a77b54df5d50206c3059053ed71be5d72f39038e065b259c63da1cb1ec6f"} Jun 03 23:37:15.332473 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:15.332430 2568 generic.go:356] "Generic (PLEG): container finished" podID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerID="9f9297c1bfcaaeefd72f73339b69c3f581706f316171a8772ff6f33c170e9bf3" exitCode=0 Jun 03 23:37:15.332919 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:15.332530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" event={"ID":"cffe531c-e49e-44c7-a0e6-8e52ee7882c7","Type":"ContainerDied","Data":"9f9297c1bfcaaeefd72f73339b69c3f581706f316171a8772ff6f33c170e9bf3"} Jun 03 23:37:16.339717 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:16.339674 2568 generic.go:356] "Generic (PLEG): container finished" podID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerID="c16cc8ab9242186a5fb2f11d6dd1cc20c44e006b613f6021d9b6d9b56c677d17" exitCode=0 Jun 03 23:37:16.340204 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:16.339751 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" event={"ID":"cffe531c-e49e-44c7-a0e6-8e52ee7882c7","Type":"ContainerDied","Data":"c16cc8ab9242186a5fb2f11d6dd1cc20c44e006b613f6021d9b6d9b56c677d17"} Jun 03 23:37:17.481416 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.481388 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:17.601333 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.601242 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-util\") pod \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " Jun 03 23:37:17.601333 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.601285 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-bundle\") pod \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " Jun 03 23:37:17.601333 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.601317 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68mgr\" (UniqueName: \"kubernetes.io/projected/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-kube-api-access-68mgr\") pod \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\" (UID: \"cffe531c-e49e-44c7-a0e6-8e52ee7882c7\") " Jun 03 23:37:17.601885 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.601826 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-bundle" (OuterVolumeSpecName: "bundle") pod "cffe531c-e49e-44c7-a0e6-8e52ee7882c7" (UID: "cffe531c-e49e-44c7-a0e6-8e52ee7882c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:37:17.603419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.603396 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-kube-api-access-68mgr" (OuterVolumeSpecName: "kube-api-access-68mgr") pod "cffe531c-e49e-44c7-a0e6-8e52ee7882c7" (UID: "cffe531c-e49e-44c7-a0e6-8e52ee7882c7"). InnerVolumeSpecName "kube-api-access-68mgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:37:17.606947 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.606916 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-util" (OuterVolumeSpecName: "util") pod "cffe531c-e49e-44c7-a0e6-8e52ee7882c7" (UID: "cffe531c-e49e-44c7-a0e6-8e52ee7882c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:37:17.702618 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.702581 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:37:17.702618 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.702614 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:37:17.702618 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:17.702624 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68mgr\" (UniqueName: \"kubernetes.io/projected/cffe531c-e49e-44c7-a0e6-8e52ee7882c7-kube-api-access-68mgr\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:37:18.353209 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:18.353179 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" Jun 03 23:37:18.353383 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:18.353210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rr6n9" event={"ID":"cffe531c-e49e-44c7-a0e6-8e52ee7882c7","Type":"ContainerDied","Data":"04a3a77b54df5d50206c3059053ed71be5d72f39038e065b259c63da1cb1ec6f"} Jun 03 23:37:18.353383 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:18.353257 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04a3a77b54df5d50206c3059053ed71be5d72f39038e065b259c63da1cb1ec6f" Jun 03 23:37:20.787241 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787202 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-wkw9t"] Jun 03 23:37:20.787760 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787699 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="util" Jun 03 23:37:20.787760 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787730 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="util" Jun 03 23:37:20.787760 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787751 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="extract" Jun 03 23:37:20.787760 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787760 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="extract" Jun 03 23:37:20.787935 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787774 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="pull" Jun 03 23:37:20.787935 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787779 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="pull" Jun 03 23:37:20.787935 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.787864 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cffe531c-e49e-44c7-a0e6-8e52ee7882c7" containerName="extract" Jun 03 23:37:20.790550 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.790534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" Jun 03 23:37:20.793330 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.793310 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:37:20.793330 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.793323 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:37:20.794317 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.794299 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-zg76w\"" Jun 03 23:37:20.800035 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.800011 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-wkw9t"] Jun 03 23:37:20.929236 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:20.929202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpz6d\" (UniqueName: \"kubernetes.io/projected/9e48274a-20e4-4c68-979a-906fc49909f9-kube-api-access-cpz6d\") pod \"keycloak-operator-dd84cbf46-wkw9t\" (UID: \"9e48274a-20e4-4c68-979a-906fc49909f9\") " pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" Jun 03 23:37:21.030539 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:21.030507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpz6d\" (UniqueName: \"kubernetes.io/projected/9e48274a-20e4-4c68-979a-906fc49909f9-kube-api-access-cpz6d\") pod \"keycloak-operator-dd84cbf46-wkw9t\" (UID: \"9e48274a-20e4-4c68-979a-906fc49909f9\") " pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" Jun 03 23:37:21.058414 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:21.058354 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpz6d\" (UniqueName: \"kubernetes.io/projected/9e48274a-20e4-4c68-979a-906fc49909f9-kube-api-access-cpz6d\") pod \"keycloak-operator-dd84cbf46-wkw9t\" (UID: \"9e48274a-20e4-4c68-979a-906fc49909f9\") " pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" Jun 03 23:37:21.101467 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:21.101426 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" Jun 03 23:37:21.246401 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:21.246375 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-wkw9t"] Jun 03 23:37:21.248060 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:37:21.248033 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e48274a_20e4_4c68_979a_906fc49909f9.slice/crio-4b43021b508a7bce0ac5ac58cfd9db469177b46487a53752ea2d7f7e794e888d WatchSource:0}: Error finding container 4b43021b508a7bce0ac5ac58cfd9db469177b46487a53752ea2d7f7e794e888d: Status 404 returned error can't find the container with id 4b43021b508a7bce0ac5ac58cfd9db469177b46487a53752ea2d7f7e794e888d Jun 03 23:37:21.369470 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:21.369432 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" event={"ID":"9e48274a-20e4-4c68-979a-906fc49909f9","Type":"ContainerStarted","Data":"4b43021b508a7bce0ac5ac58cfd9db469177b46487a53752ea2d7f7e794e888d"} Jun 03 23:37:26.401919 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:26.401880 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" event={"ID":"9e48274a-20e4-4c68-979a-906fc49909f9","Type":"ContainerStarted","Data":"9b3cc594f2150e6981da7894123edf0c2b517cba1dfeee6c7dde07e2ad6cd029"} Jun 03 23:37:26.420434 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:37:26.420371 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-wkw9t" podStartSLOduration=1.671090945 podStartE2EDuration="6.420354843s" totalImagesPullingTime="4.749263898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:26.418871089 +0000 UTC m=+773.668713200" watchObservedRunningTime="2026-06-03 23:37:26.420354843 +0000 UTC m=+773.670196961" Jun 03 23:40:01.696426 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.696380 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2"] Jun 03 23:40:01.698799 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.698783 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.702736 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.702709 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:40:01.702889 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.702740 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 23:40:01.702889 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.702748 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:40:01.703062 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.703049 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwhdp\"" Jun 03 23:40:01.712036 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.712011 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2"] Jun 03 23:40:01.823623 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.823582 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.823806 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.823647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.823806 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.823680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.823806 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.823702 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9wr\" (UniqueName: \"kubernetes.io/projected/b7fdea6c-f874-4629-b62b-4e9c53a9d979-kube-api-access-7h9wr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.823806 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.823780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7fdea6c-f874-4629-b62b-4e9c53a9d979-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.824027 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.823874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925137 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7fdea6c-f874-4629-b62b-4e9c53a9d979-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925345 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9wr\" (UniqueName: \"kubernetes.io/projected/b7fdea6c-f874-4629-b62b-4e9c53a9d979-kube-api-access-7h9wr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925770 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925736 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925896 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925777 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.925896 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.925789 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.927475 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.927455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7fdea6c-f874-4629-b62b-4e9c53a9d979-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.927797 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.927779 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7fdea6c-f874-4629-b62b-4e9c53a9d979-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:01.934386 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:01.934359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9wr\" (UniqueName: \"kubernetes.io/projected/b7fdea6c-f874-4629-b62b-4e9c53a9d979-kube-api-access-7h9wr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2\" (UID: \"b7fdea6c-f874-4629-b62b-4e9c53a9d979\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:02.008956 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:02.008836 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:02.145438 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:02.145409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2"] Jun 03 23:40:02.147228 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:40:02.147196 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fdea6c_f874_4629_b62b_4e9c53a9d979.slice/crio-ed2f86683c7c4a4efebeabe45df244df6179c77e7959f86e5181d9bf916847d1 WatchSource:0}: Error finding container ed2f86683c7c4a4efebeabe45df244df6179c77e7959f86e5181d9bf916847d1: Status 404 returned error can't find the container with id ed2f86683c7c4a4efebeabe45df244df6179c77e7959f86e5181d9bf916847d1 Jun 03 23:40:02.149064 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:02.149047 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:40:02.242878 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:02.242821 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" event={"ID":"b7fdea6c-f874-4629-b62b-4e9c53a9d979","Type":"ContainerStarted","Data":"ed2f86683c7c4a4efebeabe45df244df6179c77e7959f86e5181d9bf916847d1"} Jun 03 23:40:05.260596 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:05.260497 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" event={"ID":"b7fdea6c-f874-4629-b62b-4e9c53a9d979","Type":"ContainerStarted","Data":"be1d851b48fbb5c9ae5316ec967c43a39027376417c1b456ca9b49e048b37661"} Jun 03 23:40:07.273416 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:07.273383 2568 generic.go:356] "Generic (PLEG): container finished" podID="b7fdea6c-f874-4629-b62b-4e9c53a9d979" containerID="be1d851b48fbb5c9ae5316ec967c43a39027376417c1b456ca9b49e048b37661" exitCode=0 Jun 03 23:40:07.273774 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:07.273451 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" event={"ID":"b7fdea6c-f874-4629-b62b-4e9c53a9d979","Type":"ContainerDied","Data":"be1d851b48fbb5c9ae5316ec967c43a39027376417c1b456ca9b49e048b37661"} Jun 03 23:40:09.286108 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:09.286070 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" event={"ID":"b7fdea6c-f874-4629-b62b-4e9c53a9d979","Type":"ContainerStarted","Data":"16f46bbca21b54cf91b4778223e32cf7132df5981469989327041b926e657e97"} Jun 03 23:40:09.310931 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:09.310876 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" podStartSLOduration=3.1749562080000002 podStartE2EDuration="8.310853669s" totalImagesPullingTime="3.854509629s" totalInitContainerRuntime="1.281387832s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:40:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:40:09.30807819 +0000 UTC m=+936.557920309" watchObservedRunningTime="2026-06-03 23:40:09.310853669 +0000 UTC m=+936.560695785" Jun 03 23:40:12.009290 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:12.009251 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:12.009837 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:12.009319 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:12.023179 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:12.023146 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:40:12.315668 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:40:12.315575 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2" Jun 03 23:45:00.146429 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.146391 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675505-w7wt2"] Jun 03 23:45:00.149592 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.149574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:00.152457 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.152428 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-m7h47\"" Jun 03 23:45:00.174478 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.174448 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675505-w7wt2"] Jun 03 23:45:00.204193 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.204155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddlcl\" (UniqueName: \"kubernetes.io/projected/f42b152b-d5bf-4078-a5f0-8456516bc923-kube-api-access-ddlcl\") pod \"maas-api-key-cleanup-29675505-w7wt2\" (UID: \"f42b152b-d5bf-4078-a5f0-8456516bc923\") " pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:00.305300 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.305256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddlcl\" (UniqueName: \"kubernetes.io/projected/f42b152b-d5bf-4078-a5f0-8456516bc923-kube-api-access-ddlcl\") pod \"maas-api-key-cleanup-29675505-w7wt2\" (UID: \"f42b152b-d5bf-4078-a5f0-8456516bc923\") " pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:00.314517 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.314479 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddlcl\" (UniqueName: \"kubernetes.io/projected/f42b152b-d5bf-4078-a5f0-8456516bc923-kube-api-access-ddlcl\") pod \"maas-api-key-cleanup-29675505-w7wt2\" (UID: \"f42b152b-d5bf-4078-a5f0-8456516bc923\") " pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:00.459397 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.459310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:00.601536 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.601505 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675505-w7wt2"] Jun 03 23:45:00.603365 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:45:00.603340 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42b152b_d5bf_4078_a5f0_8456516bc923.slice/crio-05da07597004ea37310a41cebc95bf5fb42f20529cf46a7effe00b6be837bd77 WatchSource:0}: Error finding container 05da07597004ea37310a41cebc95bf5fb42f20529cf46a7effe00b6be837bd77: Status 404 returned error can't find the container with id 05da07597004ea37310a41cebc95bf5fb42f20529cf46a7effe00b6be837bd77 Jun 03 23:45:00.874960 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:00.874922 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" event={"ID":"f42b152b-d5bf-4078-a5f0-8456516bc923","Type":"ContainerStarted","Data":"05da07597004ea37310a41cebc95bf5fb42f20529cf46a7effe00b6be837bd77"} Jun 03 23:45:03.895481 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:03.895445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" event={"ID":"f42b152b-d5bf-4078-a5f0-8456516bc923","Type":"ContainerStarted","Data":"8a96273bb05fbc8264d570212a8b02d04e67d353c27a67443f0d3e0254c645ec"} Jun 03 23:45:03.916191 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:03.916120 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" podStartSLOduration=1.676128281 podStartE2EDuration="3.916102374s" totalImagesPullingTime="2.239974093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:45:03.914327837 +0000 UTC m=+1231.164169954" watchObservedRunningTime="2026-06-03 23:45:03.916102374 +0000 UTC m=+1231.165944492" Jun 03 23:45:04.908857 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:04.908805 2568 generic.go:356] "Generic (PLEG): container finished" podID="f42b152b-d5bf-4078-a5f0-8456516bc923" containerID="8a96273bb05fbc8264d570212a8b02d04e67d353c27a67443f0d3e0254c645ec" exitCode=0 Jun 03 23:45:04.909252 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:04.908880 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" event={"ID":"f42b152b-d5bf-4078-a5f0-8456516bc923","Type":"ContainerDied","Data":"8a96273bb05fbc8264d570212a8b02d04e67d353c27a67443f0d3e0254c645ec"} Jun 03 23:45:06.059833 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.059806 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:06.154957 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.154911 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddlcl\" (UniqueName: \"kubernetes.io/projected/f42b152b-d5bf-4078-a5f0-8456516bc923-kube-api-access-ddlcl\") pod \"f42b152b-d5bf-4078-a5f0-8456516bc923\" (UID: \"f42b152b-d5bf-4078-a5f0-8456516bc923\") " Jun 03 23:45:06.157081 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.157050 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42b152b-d5bf-4078-a5f0-8456516bc923-kube-api-access-ddlcl" (OuterVolumeSpecName: "kube-api-access-ddlcl") pod "f42b152b-d5bf-4078-a5f0-8456516bc923" (UID: "f42b152b-d5bf-4078-a5f0-8456516bc923"). InnerVolumeSpecName "kube-api-access-ddlcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:45:06.256419 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.256323 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddlcl\" (UniqueName: \"kubernetes.io/projected/f42b152b-d5bf-4078-a5f0-8456516bc923-kube-api-access-ddlcl\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:45:06.921767 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.921736 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" Jun 03 23:45:06.921957 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.921744 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675505-w7wt2" event={"ID":"f42b152b-d5bf-4078-a5f0-8456516bc923","Type":"ContainerDied","Data":"05da07597004ea37310a41cebc95bf5fb42f20529cf46a7effe00b6be837bd77"} Jun 03 23:45:06.921957 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:45:06.921874 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05da07597004ea37310a41cebc95bf5fb42f20529cf46a7effe00b6be837bd77" Jun 03 23:53:27.062074 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.061988 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln"] Jun 03 23:53:27.064515 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.062239 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" podUID="deac38f4-f612-485d-b2d6-11cc1198cf32" containerName="manager" containerID="cri-o://d532e19117f65a48a65d77d243178af937092734076f16ac70c5496293f326a1" gracePeriod=10 Jun 03 23:53:27.664380 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.664344 2568 generic.go:356] "Generic (PLEG): container finished" podID="deac38f4-f612-485d-b2d6-11cc1198cf32" containerID="d532e19117f65a48a65d77d243178af937092734076f16ac70c5496293f326a1" exitCode=0 Jun 03 23:53:27.664701 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.664385 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" event={"ID":"deac38f4-f612-485d-b2d6-11cc1198cf32","Type":"ContainerDied","Data":"d532e19117f65a48a65d77d243178af937092734076f16ac70c5496293f326a1"} Jun 03 23:53:27.916477 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.916413 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:53:27.983175 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.983140 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deac38f4-f612-485d-b2d6-11cc1198cf32-extensions-socket-volume\") pod \"deac38f4-f612-485d-b2d6-11cc1198cf32\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " Jun 03 23:53:27.983355 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.983194 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzjtq\" (UniqueName: \"kubernetes.io/projected/deac38f4-f612-485d-b2d6-11cc1198cf32-kube-api-access-lzjtq\") pod \"deac38f4-f612-485d-b2d6-11cc1198cf32\" (UID: \"deac38f4-f612-485d-b2d6-11cc1198cf32\") " Jun 03 23:53:27.983572 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.983548 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deac38f4-f612-485d-b2d6-11cc1198cf32-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "deac38f4-f612-485d-b2d6-11cc1198cf32" (UID: "deac38f4-f612-485d-b2d6-11cc1198cf32"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:53:27.985240 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:27.985217 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deac38f4-f612-485d-b2d6-11cc1198cf32-kube-api-access-lzjtq" (OuterVolumeSpecName: "kube-api-access-lzjtq") pod "deac38f4-f612-485d-b2d6-11cc1198cf32" (UID: "deac38f4-f612-485d-b2d6-11cc1198cf32"). InnerVolumeSpecName "kube-api-access-lzjtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:53:28.084167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.084124 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deac38f4-f612-485d-b2d6-11cc1198cf32-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:53:28.084167 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.084161 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjtq\" (UniqueName: \"kubernetes.io/projected/deac38f4-f612-485d-b2d6-11cc1198cf32-kube-api-access-lzjtq\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 03 23:53:28.670765 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.670733 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" Jun 03 23:53:28.670972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.670777 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln" event={"ID":"deac38f4-f612-485d-b2d6-11cc1198cf32","Type":"ContainerDied","Data":"781b0e519e9b1c20f74286b2ae7bf66477a172c8405dba32acd62906ce3eb087"} Jun 03 23:53:28.670972 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.670862 2568 scope.go:117] "RemoveContainer" containerID="d532e19117f65a48a65d77d243178af937092734076f16ac70c5496293f326a1" Jun 03 23:53:28.693651 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.693619 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln"] Jun 03 23:53:28.695912 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:28.695887 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bv4ln"] Jun 03 23:53:29.224233 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:53:29.224200 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deac38f4-f612-485d-b2d6-11cc1198cf32" path="/var/lib/kubelet/pods/deac38f4-f612-485d-b2d6-11cc1198cf32/volumes" Jun 03 23:54:33.240551 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240518 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt"] Jun 03 23:54:33.241003 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240833 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deac38f4-f612-485d-b2d6-11cc1198cf32" containerName="manager" Jun 03 23:54:33.241003 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240862 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="deac38f4-f612-485d-b2d6-11cc1198cf32" containerName="manager" Jun 03 23:54:33.241003 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240876 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42b152b-d5bf-4078-a5f0-8456516bc923" containerName="cleanup" Jun 03 23:54:33.241003 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240882 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42b152b-d5bf-4078-a5f0-8456516bc923" containerName="cleanup" Jun 03 23:54:33.241003 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240948 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="deac38f4-f612-485d-b2d6-11cc1198cf32" containerName="manager" Jun 03 23:54:33.241003 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.240958 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42b152b-d5bf-4078-a5f0-8456516bc923" containerName="cleanup" Jun 03 23:54:33.243663 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.243645 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.246487 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.246461 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2ss54\"" Jun 03 23:54:33.256770 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.256739 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt"] Jun 03 23:54:33.357540 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.357510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c760832a-fce0-46a1-9a40-cd7a12bb9779-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mw4tt\" (UID: \"c760832a-fce0-46a1-9a40-cd7a12bb9779\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.357735 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.357607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvvt\" (UniqueName: \"kubernetes.io/projected/c760832a-fce0-46a1-9a40-cd7a12bb9779-kube-api-access-lsvvt\") pod \"kuadrant-operator-controller-manager-86878c769f-mw4tt\" (UID: \"c760832a-fce0-46a1-9a40-cd7a12bb9779\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.458350 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.458308 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c760832a-fce0-46a1-9a40-cd7a12bb9779-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mw4tt\" (UID: \"c760832a-fce0-46a1-9a40-cd7a12bb9779\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.458551 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.458400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvvt\" (UniqueName: \"kubernetes.io/projected/c760832a-fce0-46a1-9a40-cd7a12bb9779-kube-api-access-lsvvt\") pod \"kuadrant-operator-controller-manager-86878c769f-mw4tt\" (UID: \"c760832a-fce0-46a1-9a40-cd7a12bb9779\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.458730 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.458705 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c760832a-fce0-46a1-9a40-cd7a12bb9779-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mw4tt\" (UID: \"c760832a-fce0-46a1-9a40-cd7a12bb9779\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.467795 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.467770 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvvt\" (UniqueName: \"kubernetes.io/projected/c760832a-fce0-46a1-9a40-cd7a12bb9779-kube-api-access-lsvvt\") pod \"kuadrant-operator-controller-manager-86878c769f-mw4tt\" (UID: \"c760832a-fce0-46a1-9a40-cd7a12bb9779\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.553585 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.553497 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:33.700424 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:33.700386 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt"] Jun 03 23:54:33.702757 ip-10-0-138-87 kubenswrapper[2568]: W0603 23:54:33.702727 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc760832a_fce0_46a1_9a40_cd7a12bb9779.slice/crio-a4bbda6d86ab8cac5ac7c2b3e502c1f2707c2b5a584ffced03cfb9775c35f975 WatchSource:0}: Error finding container a4bbda6d86ab8cac5ac7c2b3e502c1f2707c2b5a584ffced03cfb9775c35f975: Status 404 returned error can't find the container with id a4bbda6d86ab8cac5ac7c2b3e502c1f2707c2b5a584ffced03cfb9775c35f975 Jun 03 23:54:34.022572 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:34.022536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" event={"ID":"c760832a-fce0-46a1-9a40-cd7a12bb9779","Type":"ContainerStarted","Data":"add0ecd216fcb06c7bacfacbfd01d2e576821141a71bb16d249bcfd077bdf94d"} Jun 03 23:54:34.022757 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:34.022590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" event={"ID":"c760832a-fce0-46a1-9a40-cd7a12bb9779","Type":"ContainerStarted","Data":"a4bbda6d86ab8cac5ac7c2b3e502c1f2707c2b5a584ffced03cfb9775c35f975"} Jun 03 23:54:34.022757 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:34.022658 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 03 23:54:34.044080 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:34.044027 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" podStartSLOduration=1.044010498 podStartE2EDuration="1.044010498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:54:34.042347268 +0000 UTC m=+1801.292189388" watchObservedRunningTime="2026-06-03 23:54:34.044010498 +0000 UTC m=+1801.293852615" Jun 03 23:54:45.031127 ip-10-0-138-87 kubenswrapper[2568]: I0603 23:54:45.031091 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mw4tt" Jun 04 00:00:00.189875 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.189811 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675520-46dvq"] Jun 04 00:00:00.193488 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.193458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:00:00.197103 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.197075 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-m7h47\"" Jun 04 00:00:00.210058 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.210023 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675520-46dvq"] Jun 04 00:00:00.274769 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.274718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4788k\" (UniqueName: \"kubernetes.io/projected/f8d76d9c-dd45-4786-a3c5-53c513cf63fc-kube-api-access-4788k\") pod \"maas-api-key-cleanup-29675520-46dvq\" (UID: \"f8d76d9c-dd45-4786-a3c5-53c513cf63fc\") " pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:00:00.376301 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.376256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4788k\" (UniqueName: \"kubernetes.io/projected/f8d76d9c-dd45-4786-a3c5-53c513cf63fc-kube-api-access-4788k\") pod \"maas-api-key-cleanup-29675520-46dvq\" (UID: \"f8d76d9c-dd45-4786-a3c5-53c513cf63fc\") " pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:00:00.385058 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.385020 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4788k\" (UniqueName: \"kubernetes.io/projected/f8d76d9c-dd45-4786-a3c5-53c513cf63fc-kube-api-access-4788k\") pod \"maas-api-key-cleanup-29675520-46dvq\" (UID: \"f8d76d9c-dd45-4786-a3c5-53c513cf63fc\") " pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:00:00.529190 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.529095 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:00:00.684300 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.684273 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675520-46dvq"] Jun 04 00:00:00.686374 ip-10-0-138-87 kubenswrapper[2568]: W0604 00:00:00.686350 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d76d9c_dd45_4786_a3c5_53c513cf63fc.slice/crio-966f5d2c8cfe31984149ebaaa04df08f49179bab0373319a166689a49119fb45 WatchSource:0}: Error finding container 966f5d2c8cfe31984149ebaaa04df08f49179bab0373319a166689a49119fb45: Status 404 returned error can't find the container with id 966f5d2c8cfe31984149ebaaa04df08f49179bab0373319a166689a49119fb45 Jun 04 00:00:00.866237 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:00.866202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" event={"ID":"f8d76d9c-dd45-4786-a3c5-53c513cf63fc","Type":"ContainerStarted","Data":"966f5d2c8cfe31984149ebaaa04df08f49179bab0373319a166689a49119fb45"} Jun 04 00:00:01.875897 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:01.875860 2568 generic.go:356] "Generic (PLEG): container finished" podID="f8d76d9c-dd45-4786-a3c5-53c513cf63fc" containerID="4ac11e7c38f4b5fdd78f63cf6dca4e0fc826596774d9ab7378fce15eecdacc38" exitCode=0 Jun 04 00:00:01.876279 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:01.875922 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" event={"ID":"f8d76d9c-dd45-4786-a3c5-53c513cf63fc","Type":"ContainerDied","Data":"4ac11e7c38f4b5fdd78f63cf6dca4e0fc826596774d9ab7378fce15eecdacc38"} Jun 04 00:00:03.035320 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.035281 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:00:03.100937 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.100883 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4788k\" (UniqueName: \"kubernetes.io/projected/f8d76d9c-dd45-4786-a3c5-53c513cf63fc-kube-api-access-4788k\") pod \"f8d76d9c-dd45-4786-a3c5-53c513cf63fc\" (UID: \"f8d76d9c-dd45-4786-a3c5-53c513cf63fc\") " Jun 04 00:00:03.103111 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.103075 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d76d9c-dd45-4786-a3c5-53c513cf63fc-kube-api-access-4788k" (OuterVolumeSpecName: "kube-api-access-4788k") pod "f8d76d9c-dd45-4786-a3c5-53c513cf63fc" (UID: "f8d76d9c-dd45-4786-a3c5-53c513cf63fc"). InnerVolumeSpecName "kube-api-access-4788k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 00:00:03.201997 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.201887 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4788k\" (UniqueName: \"kubernetes.io/projected/f8d76d9c-dd45-4786-a3c5-53c513cf63fc-kube-api-access-4788k\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 04 00:00:03.888008 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.887970 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" event={"ID":"f8d76d9c-dd45-4786-a3c5-53c513cf63fc","Type":"ContainerDied","Data":"966f5d2c8cfe31984149ebaaa04df08f49179bab0373319a166689a49119fb45"} Jun 04 00:00:03.888180 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.888057 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="966f5d2c8cfe31984149ebaaa04df08f49179bab0373319a166689a49119fb45" Jun 04 00:00:03.888180 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:00:03.887987 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675520-46dvq" Jun 04 00:05:13.406000 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:13.405968 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c7b778c9c-kgsfw_27897d15-dc0e-4b98-8604-11ad02e62ba7/nginx/0.log" Jun 04 00:05:13.639099 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:13.639063 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-csdmj_6b638dea-4302-48a6-98dd-6a4a105cbc1e/manager/0.log" Jun 04 00:05:13.764516 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:13.764406 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kq2sn_f0ec0619-1e89-46e0-91e9-28ec0496ee1d/manager/0.log" Jun 04 00:05:14.001109 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.001078 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675505-w7wt2_f42b152b-d5bf-4078-a5f0-8456516bc923/cleanup/0.log" Jun 04 00:05:14.118426 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.118399 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675520-46dvq_f8d76d9c-dd45-4786-a3c5-53c513cf63fc/cleanup/0.log" Jun 04 00:05:14.364651 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.364623 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-s96x5_5d17ec06-df98-4a6b-b2de-2c027eeb3d70/server/0.log" Jun 04 00:05:14.485230 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.485148 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-x5wpn_b8d56378-7f49-45e3-a031-5c218c092bd4/manager/0.log" Jun 04 00:05:14.855284 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.855253 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ww92d_5a1eb756-f4e9-4889-899a-121c334823ca/manager/0.log" Jun 04 00:05:14.862858 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.862814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ww92d_5a1eb756-f4e9-4889-899a-121c334823ca/copy-manifests/0.log" Jun 04 00:05:14.973290 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:14.973263 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vw4hm_4fc329a9-53f5-48f2-9ef3-e85f7cb47583/postgres/0.log" Jun 04 00:05:15.786048 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:15.786014 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6_5395ac3f-81e0-45c0-aaff-9280ea153def/util/0.log" Jun 04 00:05:15.792712 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:15.792691 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6_5395ac3f-81e0-45c0-aaff-9280ea153def/pull/0.log" Jun 04 00:05:15.798456 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:15.798439 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6_5395ac3f-81e0-45c0-aaff-9280ea153def/extract/0.log" Jun 04 00:05:15.915769 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:15.915741 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks_f697e6da-fe49-47f6-8648-768e1e77c248/util/0.log" Jun 04 00:05:15.922426 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:15.922392 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks_f697e6da-fe49-47f6-8648-768e1e77c248/pull/0.log" Jun 04 00:05:15.928915 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:15.928886 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks_f697e6da-fe49-47f6-8648-768e1e77c248/extract/0.log" Jun 04 00:05:16.048586 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.048495 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md_043bbdde-c094-433d-88f0-1bfdf80b9346/extract/0.log" Jun 04 00:05:16.054736 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.054710 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md_043bbdde-c094-433d-88f0-1bfdf80b9346/util/0.log" Jun 04 00:05:16.064039 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.064018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md_043bbdde-c094-433d-88f0-1bfdf80b9346/pull/0.log" Jun 04 00:05:16.177347 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.177319 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8_9f22e844-7052-4695-bddf-c68ade830bd6/util/0.log" Jun 04 00:05:16.186135 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.186110 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8_9f22e844-7052-4695-bddf-c68ade830bd6/pull/0.log" Jun 04 00:05:16.192779 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.192762 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8_9f22e844-7052-4695-bddf-c68ade830bd6/extract/0.log" Jun 04 00:05:16.556637 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.556609 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pwbpj_6c278178-d7eb-4dc2-b801-c4d1ca37c06e/manager/0.log" Jun 04 00:05:16.922083 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:16.922052 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mw4tt_c760832a-fce0-46a1-9a40-cd7a12bb9779/manager/0.log" Jun 04 00:05:17.650262 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:17.650231 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fj4pr_1d2660f2-5a7d-4732-9c1f-b502de1ac508/discovery/0.log" Jun 04 00:05:17.885274 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:17.885245 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57684f659d-p8ghl_b5820911-1b21-42df-ad5c-3d74522aa540/kube-auth-proxy/0.log" Jun 04 00:05:19.100740 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:19.100714 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2_b7fdea6c-f874-4629-b62b-4e9c53a9d979/storage-initializer/0.log" Jun 04 00:05:19.107787 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:19.107747 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfnz2_b7fdea6c-f874-4629-b62b-4e9c53a9d979/main/0.log" Jun 04 00:05:26.504036 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:26.504008 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4zng4_e21b674e-54d2-4be0-aaf1-1da9587f9ca6/global-pull-secret-syncer/0.log" Jun 04 00:05:26.676833 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:26.672886 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5b6wc_9093d3c7-76d7-4b85-af01-3f89a79078f3/konnectivity-agent/0.log" Jun 04 00:05:26.771788 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:26.771703 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-87.ec2.internal_ec9151502287c53bc92d18ac37228f32/haproxy/0.log" Jun 04 00:05:30.898271 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:30.898237 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-fxm56_dff06694-4b35-4160-b68a-9e002e9c1c53/sail-operator/0.log" Jun 04 00:05:31.387639 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.387610 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6_5395ac3f-81e0-45c0-aaff-9280ea153def/extract/0.log" Jun 04 00:05:31.409578 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.409546 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6_5395ac3f-81e0-45c0-aaff-9280ea153def/util/0.log" Jun 04 00:05:31.432628 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.432594 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gccf6_5395ac3f-81e0-45c0-aaff-9280ea153def/pull/0.log" Jun 04 00:05:31.473141 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.473112 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks_f697e6da-fe49-47f6-8648-768e1e77c248/extract/0.log" Jun 04 00:05:31.498614 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.498581 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks_f697e6da-fe49-47f6-8648-768e1e77c248/util/0.log" Jun 04 00:05:31.523418 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.523391 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxcks_f697e6da-fe49-47f6-8648-768e1e77c248/pull/0.log" Jun 04 00:05:31.560553 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.560516 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md_043bbdde-c094-433d-88f0-1bfdf80b9346/extract/0.log" Jun 04 00:05:31.583531 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.583501 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md_043bbdde-c094-433d-88f0-1bfdf80b9346/util/0.log" Jun 04 00:05:31.603965 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.603937 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv9md_043bbdde-c094-433d-88f0-1bfdf80b9346/pull/0.log" Jun 04 00:05:31.630448 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.630414 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8_9f22e844-7052-4695-bddf-c68ade830bd6/extract/0.log" Jun 04 00:05:31.650538 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.650456 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8_9f22e844-7052-4695-bddf-c68ade830bd6/util/0.log" Jun 04 00:05:31.671397 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.671368 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lwjn8_9f22e844-7052-4695-bddf-c68ade830bd6/pull/0.log" Jun 04 00:05:31.967739 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:31.967628 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pwbpj_6c278178-d7eb-4dc2-b801-c4d1ca37c06e/manager/0.log" Jun 04 00:05:32.120479 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:32.120438 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mw4tt_c760832a-fce0-46a1-9a40-cd7a12bb9779/manager/0.log" Jun 04 00:05:34.191478 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:34.191449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7987c88868-g4t2k_e2460577-16ed-492a-afe9-11ed389d4b16/metrics-server/0.log" Jun 04 00:05:34.414957 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:34.414927 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nd7z5_782aa7ce-d702-4e3a-8145-56f18230c8dd/node-exporter/0.log" Jun 04 00:05:34.435190 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:34.435164 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nd7z5_782aa7ce-d702-4e3a-8145-56f18230c8dd/kube-rbac-proxy/0.log" Jun 04 00:05:34.458826 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:34.458746 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nd7z5_782aa7ce-d702-4e3a-8145-56f18230c8dd/init-textfile/0.log" Jun 04 00:05:38.865807 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.865768 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5"] Jun 04 00:05:38.866292 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.866278 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d76d9c-dd45-4786-a3c5-53c513cf63fc" containerName="cleanup" Jun 04 00:05:38.866345 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.866296 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d76d9c-dd45-4786-a3c5-53c513cf63fc" containerName="cleanup" Jun 04 00:05:38.866401 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.866364 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d76d9c-dd45-4786-a3c5-53c513cf63fc" containerName="cleanup" Jun 04 00:05:38.869360 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.869340 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:38.873887 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.873866 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6rbj\"/\"openshift-service-ca.crt\"" Jun 04 00:05:38.874013 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.873946 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6rbj\"/\"kube-root-ca.crt\"" Jun 04 00:05:38.874975 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.874955 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6rbj\"/\"default-dockercfg-nw9sd\"" Jun 04 00:05:38.881285 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.881260 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5"] Jun 04 00:05:38.918963 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.918927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlf9\" (UniqueName: \"kubernetes.io/projected/1434cd68-cbce-4a5e-8445-ebf28404d8af-kube-api-access-jwlf9\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:38.919166 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.918983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-proc\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:38.919166 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.919063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-sys\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:38.919166 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.919100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-lib-modules\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:38.919166 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:38.919119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-podres\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.019996 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.019960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-lib-modules\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.019996 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.019997 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-podres\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020254 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlf9\" (UniqueName: \"kubernetes.io/projected/1434cd68-cbce-4a5e-8445-ebf28404d8af-kube-api-access-jwlf9\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020254 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020145 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-podres\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020254 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-lib-modules\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020254 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020178 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-proc\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020254 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020225 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-proc\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020254 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020247 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-sys\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.020560 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.020337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1434cd68-cbce-4a5e-8445-ebf28404d8af-sys\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.028225 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.028198 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlf9\" (UniqueName: \"kubernetes.io/projected/1434cd68-cbce-4a5e-8445-ebf28404d8af-kube-api-access-jwlf9\") pod \"perf-node-gather-daemonset-rnll5\" (UID: \"1434cd68-cbce-4a5e-8445-ebf28404d8af\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.180314 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.180220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.317502 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.317474 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5"] Jun 04 00:05:39.319658 ip-10-0-138-87 kubenswrapper[2568]: W0604 00:05:39.319626 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1434cd68_cbce_4a5e_8445_ebf28404d8af.slice/crio-d8f687ca7f4028340d5f72073c02c9de485f06eb45ef3626eb5ba9e4b19aac95 WatchSource:0}: Error finding container d8f687ca7f4028340d5f72073c02c9de485f06eb45ef3626eb5ba9e4b19aac95: Status 404 returned error can't find the container with id d8f687ca7f4028340d5f72073c02c9de485f06eb45ef3626eb5ba9e4b19aac95 Jun 04 00:05:39.748703 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.748669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" event={"ID":"1434cd68-cbce-4a5e-8445-ebf28404d8af","Type":"ContainerStarted","Data":"63921cc133056074347996fac8859c179a4e64ee2a539184439a97e4c78330cf"} Jun 04 00:05:39.748911 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.748722 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" event={"ID":"1434cd68-cbce-4a5e-8445-ebf28404d8af","Type":"ContainerStarted","Data":"d8f687ca7f4028340d5f72073c02c9de485f06eb45ef3626eb5ba9e4b19aac95"} Jun 04 00:05:39.748911 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.748752 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:39.777930 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:39.777877 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" podStartSLOduration=1.777854707 podStartE2EDuration="1.777854707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 00:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:05:39.774313866 +0000 UTC m=+2467.024155983" watchObservedRunningTime="2026-06-04 00:05:39.777854707 +0000 UTC m=+2467.027696819" Jun 04 00:05:40.004310 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:40.004222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jbffp_67057f66-c324-490b-9e5e-d665b3acc465/dns/0.log" Jun 04 00:05:40.033573 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:40.033544 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jbffp_67057f66-c324-490b-9e5e-d665b3acc465/kube-rbac-proxy/0.log" Jun 04 00:05:40.195280 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:40.195251 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v8jdn_2fb6564d-f707-40af-81f9-3aae39c4c705/dns-node-resolver/0.log" Jun 04 00:05:40.779273 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:40.779243 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-674b5cfd45-cp8kx_e16764c7-056e-4832-a33c-f0a1137433ff/registry/0.log" Jun 04 00:05:40.825051 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:40.825021 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnz2l_caa35324-f4af-4076-92d3-a6f6d67ce265/node-ca/0.log" Jun 04 00:05:41.906031 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:41.905999 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fj4pr_1d2660f2-5a7d-4732-9c1f-b502de1ac508/discovery/0.log" Jun 04 00:05:41.949902 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:41.949872 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57684f659d-p8ghl_b5820911-1b21-42df-ad5c-3d74522aa540/kube-auth-proxy/0.log" Jun 04 00:05:42.835715 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:42.835687 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghkgz_22f6e610-93ff-4b38-b514-d29e64371f1f/serve-healthcheck-canary/0.log" Jun 04 00:05:43.554925 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:43.554897 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr64j_83a86d50-cfbd-40e2-a185-e559dd5428fe/kube-rbac-proxy/0.log" Jun 04 00:05:43.611832 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:43.611799 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr64j_83a86d50-cfbd-40e2-a185-e559dd5428fe/exporter/0.log" Jun 04 00:05:43.657752 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:43.657718 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr64j_83a86d50-cfbd-40e2-a185-e559dd5428fe/extractor/0.log" Jun 04 00:05:45.763721 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:45.763695 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnll5" Jun 04 00:05:45.899999 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:45.899972 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c7b778c9c-kgsfw_27897d15-dc0e-4b98-8604-11ad02e62ba7/nginx/0.log" Jun 04 00:05:45.946261 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:45.946229 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-csdmj_6b638dea-4302-48a6-98dd-6a4a105cbc1e/manager/0.log" Jun 04 00:05:46.019314 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.019223 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kq2sn_f0ec0619-1e89-46e0-91e9-28ec0496ee1d/manager/0.log" Jun 04 00:05:46.069865 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.069821 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675505-w7wt2_f42b152b-d5bf-4078-a5f0-8456516bc923/cleanup/0.log" Jun 04 00:05:46.095213 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.095178 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675520-46dvq_f8d76d9c-dd45-4786-a3c5-53c513cf63fc/cleanup/0.log" Jun 04 00:05:46.187230 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.187199 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-s96x5_5d17ec06-df98-4a6b-b2de-2c027eeb3d70/server/0.log" Jun 04 00:05:46.239600 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.239570 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-x5wpn_b8d56378-7f49-45e3-a031-5c218c092bd4/manager/0.log" Jun 04 00:05:46.438448 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.438413 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ww92d_5a1eb756-f4e9-4889-899a-121c334823ca/manager/0.log" Jun 04 00:05:46.457739 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.457712 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ww92d_5a1eb756-f4e9-4889-899a-121c334823ca/copy-manifests/0.log" Jun 04 00:05:46.481381 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:46.481352 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vw4hm_4fc329a9-53f5-48f2-9ef3-e85f7cb47583/postgres/0.log" Jun 04 00:05:52.286381 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:52.286346 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fj4pr_1d2660f2-5a7d-4732-9c1f-b502de1ac508/discovery/0.log" Jun 04 00:05:52.317736 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:52.317710 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57684f659d-p8ghl_b5820911-1b21-42df-ad5c-3d74522aa540/kube-auth-proxy/0.log" Jun 04 00:05:53.713250 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:53.713212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fj4pr_1d2660f2-5a7d-4732-9c1f-b502de1ac508/discovery/0.log" Jun 04 00:05:53.739746 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:53.739708 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57684f659d-p8ghl_b5820911-1b21-42df-ad5c-3d74522aa540/kube-auth-proxy/0.log" Jun 04 00:05:55.410263 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.410235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/kube-multus-additional-cni-plugins/0.log" Jun 04 00:05:55.431112 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.431080 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/egress-router-binary-copy/0.log" Jun 04 00:05:55.450313 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.450282 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/cni-plugins/0.log" Jun 04 00:05:55.470101 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.470078 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/bond-cni-plugin/0.log" Jun 04 00:05:55.490729 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.490693 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/routeoverride-cni/0.log" Jun 04 00:05:55.511409 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.511384 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/whereabouts-cni-bincopy/0.log" Jun 04 00:05:55.530969 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.530939 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jtv8h_4a8e699f-0555-404f-ba4b-7b40b3de1f79/whereabouts-cni/0.log" Jun 04 00:05:55.689899 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.689865 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fj4pr_1d2660f2-5a7d-4732-9c1f-b502de1ac508/discovery/0.log" Jun 04 00:05:55.714742 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.714716 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57684f659d-p8ghl_b5820911-1b21-42df-ad5c-3d74522aa540/kube-auth-proxy/0.log" Jun 04 00:05:55.905116 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.905083 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pml5c_a06e1668-4b1f-4531-9b40-7bcab1c52f2a/kube-multus/0.log" Jun 04 00:05:55.996342 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:55.996268 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hm8cg_55062c7a-cad0-49d8-90a0-6e9322eeaef7/network-metrics-daemon/0.log" Jun 04 00:05:56.014537 ip-10-0-138-87 kubenswrapper[2568]: I0604 00:05:56.014515 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hm8cg_55062c7a-cad0-49d8-90a0-6e9322eeaef7/kube-rbac-proxy/0.log"