Jun 03 00:46:28.897098 ip-10-0-140-130 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 00:46:28.897113 ip-10-0-140-130 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 00:46:28.897123 ip-10-0-140-130 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 00:46:28.897418 ip-10-0-140-130 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 00:46:39.146117 ip-10-0-140-130 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 00:46:39.146136 ip-10-0-140-130 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4f0e170af79944db975c140262572576 -- Jun 03 00:49:04.010820 ip-10-0-140-130 systemd[1]: Starting Kubernetes Kubelet... Jun 03 00:49:04.423868 ip-10-0-140-130 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:49:04.423868 ip-10-0-140-130 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 00:49:04.423868 ip-10-0-140-130 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:49:04.423868 ip-10-0-140-130 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 00:49:04.423868 ip-10-0-140-130 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:49:04.425477 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.425383 2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 00:49:04.430790 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430770 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:49:04.430790 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430787 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:49:04.430790 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430792 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:49:04.430790 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430796 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430801 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430806 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430810 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430813 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430817 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430820 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430824 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430828 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430832 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430836 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430840 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430843 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430849 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430853 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430857 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430861 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430865 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430869 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430873 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:49:04.431028 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430879 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430885 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430888 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430893 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430896 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430900 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430904 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430909 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430913 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430917 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430922 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430926 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430930 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430934 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430939 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430943 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430948 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430952 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430957 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430961 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:49:04.431853 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430966 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430970 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430974 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430978 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430983 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430987 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430990 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.430995 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431000 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431004 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431008 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431012 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431016 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431020 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431025 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431029 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431032 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431036 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431041 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431045 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:49:04.432379 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431049 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431054 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431059 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431065 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431071 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431076 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431081 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431086 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431090 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431094 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431098 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431102 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431107 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431111 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431115 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431119 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431123 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431127 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431131 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:49:04.433229 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431137 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431142 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431145 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.431152 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432426 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432437 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432442 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432448 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432453 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432458 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432462 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432466 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432470 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432474 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432478 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432482 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432492 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432496 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432500 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:49:04.434042 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432506 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432510 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432533 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432538 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432542 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432546 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432550 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432554 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432558 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432562 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432567 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432571 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432575 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432579 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432585 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432591 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432596 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432600 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432604 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432608 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:49:04.434696 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432612 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432616 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432620 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432624 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432628 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432633 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432636 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432641 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432645 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432649 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432654 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432659 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432665 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432669 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432673 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432677 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432682 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432686 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432690 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432694 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:49:04.435304 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432698 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432702 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432706 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432711 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432715 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432719 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432724 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432731 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432737 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432742 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432746 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432751 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432756 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432760 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432765 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432769 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432774 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432781 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432785 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:49:04.435918 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432790 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432794 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432799 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432803 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432809 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432814 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432818 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432822 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432826 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432830 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432834 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.432847 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.432964 2570 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.432978 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.432990 2570 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.432998 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433013 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433018 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433025 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433032 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433037 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 00:49:04.436544 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433042 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433048 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433053 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433058 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433063 2570 flags.go:64] FLAG: --cgroup-root="" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433068 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433073 2570 flags.go:64] FLAG: --client-ca-file="" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433077 2570 flags.go:64] FLAG: --cloud-config="" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433083 2570 flags.go:64] FLAG: --cloud-provider="external" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433088 2570 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433094 2570 flags.go:64] FLAG: --cluster-domain="" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433099 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433105 2570 flags.go:64] FLAG: --config-dir="" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433109 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433115 2570 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433121 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433127 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433133 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433139 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433143 2570 flags.go:64] FLAG: --contention-profiling="false" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433148 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433154 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433159 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433164 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433170 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 00:49:04.437068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433175 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433180 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433185 2570 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433190 2570 flags.go:64] FLAG: --enable-server="true" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433195 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433202 2570 flags.go:64] FLAG: --event-burst="100" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433207 2570 flags.go:64] FLAG: --event-qps="50" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433213 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433218 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433223 2570 flags.go:64] FLAG: --eviction-hard="" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433229 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433233 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433238 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433243 2570 flags.go:64] FLAG: --eviction-soft="" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433248 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433252 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433257 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433262 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433267 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433272 2570 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433277 2570 flags.go:64] FLAG: --feature-gates="" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433283 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433288 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433294 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433309 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433314 2570 flags.go:64] FLAG: --healthz-port="10248" Jun 03 00:49:04.437791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433319 2570 flags.go:64] FLAG: --help="false" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433324 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433329 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433334 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433339 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433344 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433350 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433354 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433359 2570 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433364 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433368 2570 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433373 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433378 2570 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433387 2570 flags.go:64] FLAG: --kube-reserved="" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433391 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433396 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433401 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433405 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433410 2570 flags.go:64] FLAG: --lock-file="" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433415 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433419 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433424 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433433 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 00:49:04.438408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433439 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433443 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433448 2570 flags.go:64] FLAG: --logging-format="text" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433452 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433458 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433463 2570 flags.go:64] FLAG: --manifest-url="" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433468 2570 flags.go:64] FLAG: --manifest-url-header="" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433474 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433487 2570 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433494 2570 flags.go:64] FLAG: --max-pods="110" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433499 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433503 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433508 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433532 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433537 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433541 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433546 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433566 2570 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433571 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433576 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433581 2570 flags.go:64] FLAG: --pod-cidr="" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433586 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433597 2570 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433602 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 00:49:04.439086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433607 2570 flags.go:64] FLAG: --pods-per-core="0" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433612 2570 flags.go:64] FLAG: --port="10250" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433616 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433622 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ae87b2cc1ff2d2e" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433627 2570 flags.go:64] FLAG: --qos-reserved="" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433632 2570 flags.go:64] FLAG: --read-only-port="10255" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433637 2570 flags.go:64] FLAG: --register-node="true" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433641 2570 flags.go:64] FLAG: --register-schedulable="true" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433646 2570 flags.go:64] FLAG: --register-with-taints="" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433656 2570 flags.go:64] FLAG: --registry-burst="10" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433660 2570 flags.go:64] FLAG: --registry-qps="5" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433665 2570 flags.go:64] FLAG: --reserved-cpus="" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433669 2570 flags.go:64] FLAG: --reserved-memory="" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433675 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433680 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433685 2570 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433689 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433695 2570 flags.go:64] FLAG: --runonce="false" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433700 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433705 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433710 2570 flags.go:64] FLAG: --seccomp-default="false" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433715 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433719 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433724 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433729 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433734 2570 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 00:49:04.439682 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433739 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433744 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433748 2570 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433754 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433760 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433765 2570 flags.go:64] FLAG: --system-cgroups="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433769 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433778 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433783 2570 flags.go:64] FLAG: --tls-cert-file="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433788 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433794 2570 flags.go:64] FLAG: --tls-min-version="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433798 2570 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433803 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433807 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433812 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433819 2570 flags.go:64] FLAG: --v="2" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433826 2570 flags.go:64] FLAG: --version="false" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433833 2570 flags.go:64] FLAG: --vmodule="" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433839 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.433845 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434001 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434009 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434015 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434019 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:49:04.440299 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434025 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434029 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434034 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434038 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434042 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434046 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434050 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434055 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434059 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434063 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434067 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434071 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434077 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434082 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434086 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434090 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434094 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434098 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434102 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434107 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:49:04.440953 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434111 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434115 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434119 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434125 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434129 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434133 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434137 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434141 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434146 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434151 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434157 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434162 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434167 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434172 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434176 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434180 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434184 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434191 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:49:04.441533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434196 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434200 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434205 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434209 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434213 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434217 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434223 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434227 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434232 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434236 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434240 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434244 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434249 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434253 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434257 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434262 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434266 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434271 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434275 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434280 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:49:04.441989 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434284 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434288 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434292 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434297 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434301 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434305 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434309 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434313 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434318 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434323 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434327 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434331 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434335 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434340 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434344 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434348 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434352 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434356 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434361 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434366 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:49:04.442532 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434370 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434374 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434378 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.434382 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.434964 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.442124 2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.442142 2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442189 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442195 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442199 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442202 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442205 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442209 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442213 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442216 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442218 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:49:04.443029 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442221 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442224 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442226 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442229 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442232 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442234 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442237 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442240 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442242 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442245 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442248 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442251 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442253 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442256 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442258 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442261 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442263 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442266 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442268 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442271 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:49:04.443431 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442274 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442277 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442281 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442285 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442290 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442293 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442296 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442298 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442300 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442303 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442306 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442308 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442311 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442313 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442316 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442318 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442321 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442323 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442326 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:49:04.443945 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442328 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442331 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442333 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442336 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442338 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442341 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442343 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442345 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442348 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442351 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442353 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442356 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442358 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442361 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442364 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442367 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442370 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442373 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442375 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442378 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:49:04.444413 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442381 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442383 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442386 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442388 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442391 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442393 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442395 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442398 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442401 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442403 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442405 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442408 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442410 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442413 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442415 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442418 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442420 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:49:04.444931 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442423 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.442428 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442547 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442553 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442556 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442559 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442563 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442568 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442571 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442574 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442578 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442581 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442584 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442587 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442589 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:49:04.445369 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442592 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442594 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442597 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442600 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442602 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442605 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442607 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442610 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442612 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442615 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442617 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442620 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442622 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442625 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442627 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442630 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442632 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442635 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442637 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442640 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:49:04.445772 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442643 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442645 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442648 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442651 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442653 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442656 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442658 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442661 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442664 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442666 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442669 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442672 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442675 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442677 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442679 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442682 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442684 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442688 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442691 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:49:04.446257 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442694 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442697 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442700 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442702 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442705 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442707 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442710 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442712 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442714 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442717 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442719 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442722 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442725 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442728 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442730 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442732 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442735 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442737 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442740 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442743 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:49:04.446739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442745 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442748 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442750 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442753 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442756 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442759 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442761 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442763 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442766 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442768 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442771 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442773 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442776 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:04.442778 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.442783 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:49:04.447219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.443557 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 00:49:04.447614 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.446147 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 00:49:04.447614 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.447075 2570 server.go:1019] "Starting client certificate rotation" Jun 03 00:49:04.447614 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.447177 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:49:04.447614 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.447218 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:49:04.473211 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.473183 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:49:04.475086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.475067 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:49:04.483188 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.483170 2570 log.go:25] "Validated CRI v1 runtime API" Jun 03 00:49:04.489742 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.489719 2570 log.go:25] "Validated CRI v1 image API" Jun 03 00:49:04.491931 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.491914 2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 00:49:04.496090 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.496067 2570 fs.go:135] Filesystem UUIDs: map[46158c30-675a-4fe9-8550-f92bbdd1191d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d518e65b-2ac4-49f4-96a3-e04965cb6fa8:/dev/nvme0n1p3] Jun 03 00:49:04.496173 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.496090 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 00:49:04.500479 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.500364 2570 manager.go:217] Machine: {Timestamp:2026-06-03 00:49:04.499826708 +0000 UTC m=+0.375760083 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093706 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a0c8bd52ea4a9d572fa6e2aa4f7b SystemUUID:ec21a0c8-bd52-ea4a-9d57-2fa6e2aa4f7b BootID:4f0e170a-f799-44db-975c-140262572576 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:52:89:c9:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:52:89:c9:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:a4:99:50:2a:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 00:49:04.501389 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.501374 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:49:04.501559 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.501547 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 00:49:04.501654 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.501641 2570 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 00:49:04.503802 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.503774 2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 00:49:04.503948 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.503803 2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-130.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 00:49:04.503998 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.503957 2570 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 00:49:04.503998 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.503965 2570 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 00:49:04.503998 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.503973 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:49:04.504510 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.504500 2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:49:04.506000 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.505989 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:49:04.506120 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.506111 2570 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 00:49:04.508150 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.508140 2570 kubelet.go:491] "Attempting to sync node with API server" Jun 03 00:49:04.508185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.508154 2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 00:49:04.508185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.508166 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 00:49:04.508185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.508175 2570 kubelet.go:397] "Adding apiserver pod source" Jun 03 00:49:04.508185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.508183 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 00:49:04.509378 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.509358 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:49:04.509454 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.509383 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:49:04.512478 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.512453 2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 00:49:04.517730 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.517711 2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 00:49:04.519652 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519639 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519658 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519665 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519670 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519683 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519692 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519699 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 00:49:04.519701 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519704 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 00:49:04.519886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519712 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 00:49:04.519886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519718 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 00:49:04.519886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519727 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 00:49:04.519886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.519732 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 00:49:04.521349 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.521338 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 00:49:04.521412 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.521350 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 00:49:04.521633 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.521612 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97hlk" Jun 03 00:49:04.523481 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.523453 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 00:49:04.523563 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.523453 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 00:49:04.524947 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.524935 2570 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 00:49:04.524997 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.524967 2570 server.go:1295] "Started kubelet" Jun 03 00:49:04.524997 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.524937 2570 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-130.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 00:49:04.525101 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.525023 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 00:49:04.525145 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.525043 2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 00:49:04.525145 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.525127 2570 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 00:49:04.525804 ip-10-0-140-130 systemd[1]: Started Kubernetes Kubelet. Jun 03 00:49:04.525927 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.525907 2570 server.go:317] "Adding debug handlers to kubelet server" Jun 03 00:49:04.526700 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.526639 2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 00:49:04.528726 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.528709 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97hlk" Jun 03 00:49:04.534750 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.534732 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 00:49:04.535104 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535087 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 00:49:04.535356 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535282 2570 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 00:49:04.535356 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535298 2570 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 00:49:04.535495 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535398 2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 00:49:04.535495 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535459 2570 reconstruct.go:97] "Volume reconstruction finished" Jun 03 00:49:04.535495 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535468 2570 reconciler.go:26] "Reconciler: start to sync state" Jun 03 00:49:04.535829 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.535796 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:04.535911 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535841 2570 factory.go:55] Registering systemd factory Jun 03 00:49:04.535911 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.535855 2570 factory.go:223] Registration of the systemd container factory successfully Jun 03 00:49:04.536082 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.536068 2570 factory.go:153] Registering CRI-O factory Jun 03 00:49:04.536082 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.536085 2570 factory.go:223] Registration of the crio container factory successfully Jun 03 00:49:04.536208 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.536138 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 00:49:04.536208 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.536159 2570 factory.go:103] Registering Raw factory Jun 03 00:49:04.536208 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.536171 2570 manager.go:1196] Started watching for new ooms in manager Jun 03 00:49:04.536430 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.536406 2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 00:49:04.536562 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.536479 2570 manager.go:319] Starting recovery of all containers Jun 03 00:49:04.539653 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.539628 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:49:04.542400 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.542224 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-130.ec2.internal\" not found" node="ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.547818 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.547792 2570 manager.go:324] Recovery completed Jun 03 00:49:04.552846 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.552833 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:49:04.554865 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.554850 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:49:04.554960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.554877 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:49:04.554960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.554887 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:49:04.555417 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.555397 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 00:49:04.555417 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.555410 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 00:49:04.555545 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.555426 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:49:04.558085 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.558073 2570 policy_none.go:49] "None policy: Start" Jun 03 00:49:04.558125 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.558089 2570 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 00:49:04.558125 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.558100 2570 state_mem.go:35] "Initializing new in-memory state store" Jun 03 00:49:04.593118 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593099 2570 manager.go:341] "Starting Device Plugin manager" Jun 03 00:49:04.593227 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.593141 2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 00:49:04.593227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593164 2570 server.go:85] "Starting device plugin registration server" Jun 03 00:49:04.593420 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593409 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 00:49:04.593455 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593422 2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 00:49:04.593558 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593534 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 00:49:04.593630 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593618 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 00:49:04.593630 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.593627 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 00:49:04.594101 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.594087 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 00:49:04.594162 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.594122 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:04.650110 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.650076 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 00:49:04.651575 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.651560 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 00:49:04.651651 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.651589 2570 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 00:49:04.651651 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.651608 2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 00:49:04.651651 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.651617 2570 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 00:49:04.651780 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.651654 2570 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 00:49:04.653961 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.653939 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:49:04.694037 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.693968 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:49:04.695533 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.695489 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:49:04.695533 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.695534 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:49:04.695658 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.695548 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:49:04.695658 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.695571 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.704034 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.704016 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.704106 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.704041 2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-130.ec2.internal\": node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:04.720265 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.720244 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:04.751991 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.751946 2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal"] Jun 03 00:49:04.752101 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.752033 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:49:04.752960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.752943 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:49:04.753043 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.752983 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:49:04.753043 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.752993 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:49:04.755098 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755084 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:49:04.755281 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755267 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.755346 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755325 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:49:04.755854 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755839 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:49:04.755914 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755864 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:49:04.755914 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755873 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:49:04.755972 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755844 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:49:04.755972 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755936 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:49:04.755972 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.755946 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:49:04.757271 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.757257 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.757323 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.757282 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:49:04.758004 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.757979 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:49:04.758062 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.758011 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:49:04.758062 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.758028 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:49:04.779151 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.779133 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-130.ec2.internal\" not found" node="ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.783340 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.783322 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-130.ec2.internal\" not found" node="ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.820872 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.820841 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:04.921155 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:04.921116 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:04.937430 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.937391 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23b0fa9429d5c156331695346ac085f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal\" (UID: \"23b0fa9429d5c156331695346ac085f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.937430 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.937434 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23b0fa9429d5c156331695346ac085f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal\" (UID: \"23b0fa9429d5c156331695346ac085f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:04.937574 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:04.937452 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b44d7c0a6240cf94f6a0c54e589f5d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-130.ec2.internal\" (UID: \"8b44d7c0a6240cf94f6a0c54e589f5d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.021891 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:05.021827 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:05.038213 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.038172 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23b0fa9429d5c156331695346ac085f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal\" (UID: \"23b0fa9429d5c156331695346ac085f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.038314 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.038222 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b44d7c0a6240cf94f6a0c54e589f5d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-130.ec2.internal\" (UID: \"8b44d7c0a6240cf94f6a0c54e589f5d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.038314 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.038264 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b44d7c0a6240cf94f6a0c54e589f5d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-130.ec2.internal\" (UID: \"8b44d7c0a6240cf94f6a0c54e589f5d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.038314 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.038267 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23b0fa9429d5c156331695346ac085f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal\" (UID: \"23b0fa9429d5c156331695346ac085f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.038439 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.038317 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23b0fa9429d5c156331695346ac085f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal\" (UID: \"23b0fa9429d5c156331695346ac085f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.038439 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.038352 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23b0fa9429d5c156331695346ac085f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal\" (UID: \"23b0fa9429d5c156331695346ac085f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.082322 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.082293 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.088145 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.088123 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.122818 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:05.122787 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:05.223304 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:05.223271 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:05.323829 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:05.323754 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:05.424235 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:05.424209 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:05.446680 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.446647 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 00:49:05.446812 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.446798 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:49:05.446851 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.446827 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:49:05.525266 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:05.525236 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-130.ec2.internal\" not found" Jun 03 00:49:05.530447 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.530406 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:44:04 +0000 UTC" deadline="2028-01-10 16:27:07.179539561 +0000 UTC" Jun 03 00:49:05.530546 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.530449 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14079h38m1.649094981s" Jun 03 00:49:05.534840 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.534818 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 00:49:05.546756 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.546736 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:49:05.563293 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.563270 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m75p9" Jun 03 00:49:05.566876 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.566858 2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:49:05.570744 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.570728 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m75p9" Jun 03 00:49:05.595478 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:05.595449 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b44d7c0a6240cf94f6a0c54e589f5d9.slice/crio-98913a883d7a0de7e6a9962800f8196e3a3fab9e7200d1e679abdd8f26c375db WatchSource:0}: Error finding container 98913a883d7a0de7e6a9962800f8196e3a3fab9e7200d1e679abdd8f26c375db: Status 404 returned error can't find the container with id 98913a883d7a0de7e6a9962800f8196e3a3fab9e7200d1e679abdd8f26c375db Jun 03 00:49:05.601251 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.601238 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:49:05.635738 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.635719 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.649688 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.649667 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:49:05.651210 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.651195 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" Jun 03 00:49:05.653191 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.653172 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:49:05.654663 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.654626 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" event={"ID":"8b44d7c0a6240cf94f6a0c54e589f5d9","Type":"ContainerStarted","Data":"98913a883d7a0de7e6a9962800f8196e3a3fab9e7200d1e679abdd8f26c375db"} Jun 03 00:49:05.657570 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:05.657555 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:49:05.682381 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:05.682352 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b0fa9429d5c156331695346ac085f3.slice/crio-ab79299c310ce41d84925f8e2429b2b3d063f8837d7ae3e78edd6c00b89b45a2 WatchSource:0}: Error finding container ab79299c310ce41d84925f8e2429b2b3d063f8837d7ae3e78edd6c00b89b45a2: Status 404 returned error can't find the container with id ab79299c310ce41d84925f8e2429b2b3d063f8837d7ae3e78edd6c00b89b45a2 Jun 03 00:49:06.434328 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.434297 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:49:06.509910 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.509877 2570 apiserver.go:52] "Watching apiserver" Jun 03 00:49:06.522072 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.522043 2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 00:49:06.522652 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.522623 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal","openshift-multus/network-metrics-daemon-nrlbr","openshift-network-diagnostics/network-check-target-hgll5","kube-system/konnectivity-agent-z6l5m","openshift-cluster-node-tuning-operator/tuned-f6lpf","openshift-dns/node-resolver-8xzmp","openshift-multus/multus-2gx8d","openshift-multus/multus-additional-cni-plugins-9n4fh","openshift-network-operator/iptables-alerter-bft57","openshift-ovn-kubernetes/ovnkube-node-jjjfg","kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d","openshift-image-registry/node-ca-l9k2p"] Jun 03 00:49:06.525535 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.525500 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.526793 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.526769 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:06.526905 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.526846 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:06.527826 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.527798 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:06.527926 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.527882 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:06.528232 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.528215 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ssllf\"" Jun 03 00:49:06.528434 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.528422 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.528585 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.528573 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.528713 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.528700 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 00:49:06.528862 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.528851 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 00:49:06.530140 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.530115 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.530351 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.530126 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.531563 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.531545 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.532296 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.532278 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 00:49:06.533129 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.532758 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.533129 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.532824 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.533129 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.532934 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.533461 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.533439 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gzlnm\"" Jun 03 00:49:06.533695 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.533677 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 00:49:06.533789 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.533695 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.533789 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.533714 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g7tsl\"" Jun 03 00:49:06.534043 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.534018 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.534118 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.534069 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.534239 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.534222 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.534301 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.534285 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8v9nb\"" Jun 03 00:49:06.534661 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.534637 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 00:49:06.535894 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.535071 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xfs87\"" Jun 03 00:49:06.535894 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.535072 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 00:49:06.535894 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.535590 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.536754 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.536735 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 00:49:06.537093 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.537077 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.537458 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.537443 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.537911 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.537892 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j2jrw\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538207 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538331 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cdsp\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538372 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538487 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538558 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538767 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.538859 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.539115 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tpgh8\"" Jun 03 00:49:06.539227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.539183 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 00:49:06.539694 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.539251 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.540238 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.540032 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.540238 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.540137 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.541217 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.541169 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qgbmj\"" Jun 03 00:49:06.541348 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.541333 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 00:49:06.541693 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.541675 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 00:49:06.541894 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.541877 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-systemd\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovnkube-script-lib\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-socket-dir-parent\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-cni-multus\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544883 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-systemd\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544906 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ad72da-6266-4888-8008-c0fe1fb7f0f5-tmp\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544932 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-run-netns\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-cni-bin\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.544978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-hostroot\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:06.545056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545036 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-env-overrides\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6j6s\" (UniqueName: \"kubernetes.io/projected/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-kube-api-access-c6j6s\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-etc-kubernetes\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545122 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-device-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545151 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-os-release\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/476605e9-d423-4615-b992-89fe786010c7-multus-daemon-config\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545228 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545251 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-modprobe-d\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-sys\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545325 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545366 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-log-socket\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545390 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-netns\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlmzc\" (UniqueName: \"kubernetes.io/projected/476605e9-d423-4615-b992-89fe786010c7-kube-api-access-xlmzc\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de330ce3-917a-4067-8725-3c256db3aea1-hosts-file\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545470 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5w5\" (UniqueName: \"kubernetes.io/projected/2f63e690-4583-4353-b39f-6ab08d09e8aa-kube-api-access-qv5w5\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.545591 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-var-lib-kubelet\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-kubelet\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545576 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-ovn\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovn-node-metrics-cert\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545629 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wmp\" (UniqueName: \"kubernetes.io/projected/37ad72da-6266-4888-8008-c0fe1fb7f0f5-kube-api-access-b2wmp\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545673 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-etc-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovnkube-config\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545732 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-cni-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-multus-certs\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38-konnectivity-ca\") pod \"konnectivity-agent-z6l5m\" (UID: \"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38\") " pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545821 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de330ce3-917a-4067-8725-3c256db3aea1-tmp-dir\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f63e690-4583-4353-b39f-6ab08d09e8aa-host-slash\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545885 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-cni-netd\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-system-cni-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.546181 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545931 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-kubernetes\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysctl-d\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.545997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-node-log\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546027 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546043 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-os-release\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546061 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzr5b\" (UniqueName: \"kubernetes.io/projected/ee87d98c-44ad-43c2-8509-1d4087086c3f-kube-api-access-hzr5b\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38-agent-certs\") pod \"konnectivity-agent-z6l5m\" (UID: \"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38\") " pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-systemd-units\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546180 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-slash\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmrl7\" (UniqueName: \"kubernetes.io/projected/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-kube-api-access-vmrl7\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546222 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-host\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-cnibin\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-k8s-cni-cncf-io\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546332 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-cnibin\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.546832 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8n6\" (UniqueName: \"kubernetes.io/projected/e7ab151a-f19d-451a-984c-613ce7a8cbb4-kube-api-access-cf8n6\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546401 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysctl-conf\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f63e690-4583-4353-b39f-6ab08d09e8aa-iptables-alerter-script\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-tuned\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546476 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-var-lib-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-serviceca\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546550 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-cni-bin\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546579 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546597 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/476605e9-d423-4615-b992-89fe786010c7-cni-binary-copy\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546631 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcmsc\" (UniqueName: \"kubernetes.io/projected/de330ce3-917a-4067-8725-3c256db3aea1-kube-api-access-fcmsc\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546656 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysconfig\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546717 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-run\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546740 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-system-cni-dir\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-lib-modules\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.547577 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546800 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-kubelet\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.548244 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546814 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-conf-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.548244 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546837 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c562s\" (UniqueName: \"kubernetes.io/projected/c962202c-84d1-454a-9a66-39775fcfb016-kube-api-access-c562s\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.548244 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.548244 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.546886 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-host\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.571284 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.571257 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:44:05 +0000 UTC" deadline="2027-11-10 01:50:44.416494027 +0000 UTC" Jun 03 00:49:06.571391 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.571311 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12601h1m37.845187598s" Jun 03 00:49:06.630335 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.630306 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:49:06.636822 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.636799 2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 00:49:06.648056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648026 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmrl7\" (UniqueName: \"kubernetes.io/projected/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-kube-api-access-vmrl7\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.648200 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648067 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-host\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.648200 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648121 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-host\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.648200 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648182 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-cnibin\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.648329 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648223 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-k8s-cni-cncf-io\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.648329 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648253 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:06.648329 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648278 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-cnibin\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.648329 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648312 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-cnibin\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.648564 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.648389 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:06.648564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648414 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8n6\" (UniqueName: \"kubernetes.io/projected/e7ab151a-f19d-451a-984c-613ce7a8cbb4-kube-api-access-cf8n6\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.648564 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.648475 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:07.148431141 +0000 UTC m=+3.024364503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:06.648564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648494 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysctl-conf\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.648564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648511 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-cnibin\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.648564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648539 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f63e690-4583-4353-b39f-6ab08d09e8aa-iptables-alerter-script\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648566 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-tuned\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648577 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-k8s-cni-cncf-io\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648589 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-var-lib-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648613 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-serviceca\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648638 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-cni-bin\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648664 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648686 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/476605e9-d423-4615-b992-89fe786010c7-cni-binary-copy\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648710 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcmsc\" (UniqueName: \"kubernetes.io/projected/de330ce3-917a-4067-8725-3c256db3aea1-kube-api-access-fcmsc\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648734 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648697 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysctl-conf\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648756 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysconfig\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648777 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-run\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.648820 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648802 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-system-cni-dir\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648828 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-lib-modules\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648853 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648878 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-kubelet\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648904 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-conf-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648931 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c562s\" (UniqueName: \"kubernetes.io/projected/c962202c-84d1-454a-9a66-39775fcfb016-kube-api-access-c562s\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648955 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648980 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-host\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648979 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.648982 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649028 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-systemd\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649049 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysconfig\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649057 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovnkube-script-lib\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649079 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-socket-dir-parent\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649093 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-run\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649094 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-cni-multus\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649119 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649143 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-systemd\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.649408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649168 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ad72da-6266-4888-8008-c0fe1fb7f0f5-tmp\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649194 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-run-netns\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649220 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-cni-bin\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649243 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-hostroot\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649279 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649302 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-env-overrides\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649326 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6j6s\" (UniqueName: \"kubernetes.io/projected/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-kube-api-access-c6j6s\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649349 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-etc-kubernetes\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649372 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-device-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649398 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-os-release\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649422 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/476605e9-d423-4615-b992-89fe786010c7-multus-daemon-config\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649449 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649474 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649550 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-serviceca\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649619 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-cni-bin\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649702 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649693 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-modprobe-d\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.650206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649748 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-sys\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649788 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649811 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-log-socket\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649831 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-netns\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649853 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmzc\" (UniqueName: \"kubernetes.io/projected/476605e9-d423-4615-b992-89fe786010c7-kube-api-access-xlmzc\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649907 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de330ce3-917a-4067-8725-3c256db3aea1-hosts-file\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649949 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5w5\" (UniqueName: \"kubernetes.io/projected/2f63e690-4583-4353-b39f-6ab08d09e8aa-kube-api-access-qv5w5\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649980 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-var-lib-kubelet\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650007 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-kubelet\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650034 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-ovn\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650061 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovn-node-metrics-cert\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650088 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650115 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wmp\" (UniqueName: \"kubernetes.io/projected/37ad72da-6266-4888-8008-c0fe1fb7f0f5-kube-api-access-b2wmp\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650141 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-etc-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650169 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovnkube-config\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650194 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-cni-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650219 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-multus-certs\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.650892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650245 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/476605e9-d423-4615-b992-89fe786010c7-cni-binary-copy\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650245 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38-konnectivity-ca\") pod \"konnectivity-agent-z6l5m\" (UID: \"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38\") " pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650281 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de330ce3-917a-4067-8725-3c256db3aea1-tmp-dir\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650307 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f63e690-4583-4353-b39f-6ab08d09e8aa-host-slash\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650333 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650652 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-cni-netd\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650709 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-system-cni-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650730 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-host\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650745 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-kubernetes\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650798 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysctl-d\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650801 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-kubernetes\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650864 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de330ce3-917a-4067-8725-3c256db3aea1-hosts-file\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.650902 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-sysctl-d\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651058 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-node-log\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651094 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651120 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-os-release\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651144 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.651411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651173 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzr5b\" (UniqueName: \"kubernetes.io/projected/ee87d98c-44ad-43c2-8509-1d4087086c3f-kube-api-access-hzr5b\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651188 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-var-lib-kubelet\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651245 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-kubelet\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651294 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-ovn\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651375 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-node-log\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651430 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651482 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-os-release\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651934 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.651981 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f63e690-4583-4353-b39f-6ab08d09e8aa-iptables-alerter-script\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652119 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-systemd\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652269 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-tuned\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652388 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f63e690-4583-4353-b39f-6ab08d09e8aa-host-slash\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652431 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de330ce3-917a-4067-8725-3c256db3aea1-tmp-dir\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652532 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652599 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-cni-netd\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652603 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-system-cni-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652657 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-socket-dir-parent\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652664 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-etc-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652735 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-multus-certs\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652746 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-cni-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.652781 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652778 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-hostroot\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652808 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38-agent-certs\") pod \"konnectivity-agent-z6l5m\" (UID: \"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38\") " pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652834 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c962202c-84d1-454a-9a66-39775fcfb016-system-cni-dir\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652844 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-systemd-units\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652881 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-slash\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652885 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-systemd-units\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.652985 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-multus-conf-dir\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.649121 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-cni-multus\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-var-lib-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653058 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-slash\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.653294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653093 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.653818 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653423 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-systemd\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.653818 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653606 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38-konnectivity-ca\") pod \"konnectivity-agent-z6l5m\" (UID: \"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38\") " pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.653818 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653667 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-env-overrides\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.654026 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.653980 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-etc-kubernetes\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.654026 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654004 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovnkube-config\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.654026 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654037 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-device-dir\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.654286 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654068 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-var-lib-kubelet\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.654286 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654109 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-os-release\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.654472 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654451 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/476605e9-d423-4615-b992-89fe786010c7-multus-daemon-config\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.654555 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654545 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-sys\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.654981 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.654961 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.655604 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.655351 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c962202c-84d1-454a-9a66-39775fcfb016-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.655604 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.655451 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-etc-modprobe-d\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.655962 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.655912 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovn-node-metrics-cert\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.656048 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.655983 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ad72da-6266-4888-8008-c0fe1fb7f0f5-tmp\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.656105 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656058 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-log-socket\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.656105 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656076 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-run-openvswitch\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.656205 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656140 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37ad72da-6266-4888-8008-c0fe1fb7f0f5-lib-modules\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.656205 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656142 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476605e9-d423-4615-b992-89fe786010c7-host-run-netns\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.656205 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656183 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-run-netns\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.656325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656200 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-host-cni-bin\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.656325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656234 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7ab151a-f19d-451a-984c-613ce7a8cbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.656887 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.656862 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38-agent-certs\") pod \"konnectivity-agent-z6l5m\" (UID: \"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38\") " pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.657582 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.657562 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-ovnkube-script-lib\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.660600 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.660505 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:06.660600 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.660572 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:06.660600 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.660585 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:06.660810 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:06.660641 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:07.160623799 +0000 UTC m=+3.036557158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:06.660875 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.660816 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" event={"ID":"23b0fa9429d5c156331695346ac085f3","Type":"ContainerStarted","Data":"ab79299c310ce41d84925f8e2429b2b3d063f8837d7ae3e78edd6c00b89b45a2"} Jun 03 00:49:06.663089 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.663047 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8n6\" (UniqueName: \"kubernetes.io/projected/e7ab151a-f19d-451a-984c-613ce7a8cbb4-kube-api-access-cf8n6\") pod \"aws-ebs-csi-driver-node-lgz2d\" (UID: \"e7ab151a-f19d-451a-984c-613ce7a8cbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.663560 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.663498 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c562s\" (UniqueName: \"kubernetes.io/projected/c962202c-84d1-454a-9a66-39775fcfb016-kube-api-access-c562s\") pod \"multus-additional-cni-plugins-9n4fh\" (UID: \"c962202c-84d1-454a-9a66-39775fcfb016\") " pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.665305 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.665285 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzr5b\" (UniqueName: \"kubernetes.io/projected/ee87d98c-44ad-43c2-8509-1d4087086c3f-kube-api-access-hzr5b\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:06.665773 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.665653 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmrl7\" (UniqueName: \"kubernetes.io/projected/a78fe96a-caf8-4817-8a6c-0bbf324e0e5b-kube-api-access-vmrl7\") pod \"ovnkube-node-jjjfg\" (UID: \"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.666084 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.666061 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlmzc\" (UniqueName: \"kubernetes.io/projected/476605e9-d423-4615-b992-89fe786010c7-kube-api-access-xlmzc\") pod \"multus-2gx8d\" (UID: \"476605e9-d423-4615-b992-89fe786010c7\") " pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.666171 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.666087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcmsc\" (UniqueName: \"kubernetes.io/projected/de330ce3-917a-4067-8725-3c256db3aea1-kube-api-access-fcmsc\") pod \"node-resolver-8xzmp\" (UID: \"de330ce3-917a-4067-8725-3c256db3aea1\") " pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.666206 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.666178 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5w5\" (UniqueName: \"kubernetes.io/projected/2f63e690-4583-4353-b39f-6ab08d09e8aa-kube-api-access-qv5w5\") pod \"iptables-alerter-bft57\" (UID: \"2f63e690-4583-4353-b39f-6ab08d09e8aa\") " pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.666933 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.666916 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6j6s\" (UniqueName: \"kubernetes.io/projected/0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5-kube-api-access-c6j6s\") pod \"node-ca-l9k2p\" (UID: \"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5\") " pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:06.667775 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.667759 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wmp\" (UniqueName: \"kubernetes.io/projected/37ad72da-6266-4888-8008-c0fe1fb7f0f5-kube-api-access-b2wmp\") pod \"tuned-f6lpf\" (UID: \"37ad72da-6266-4888-8008-c0fe1fb7f0f5\") " pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.840885 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.840801 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gx8d" Jun 03 00:49:06.848669 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.848645 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:06.857352 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.857329 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8xzmp" Jun 03 00:49:06.861953 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.861932 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" Jun 03 00:49:06.868473 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.868453 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" Jun 03 00:49:06.876001 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.875986 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bft57" Jun 03 00:49:06.883562 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.883542 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:06.889229 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.889211 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" Jun 03 00:49:06.894743 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:06.894725 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l9k2p" Jun 03 00:49:07.156911 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.156832 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:07.157065 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:07.157002 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:07.157115 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:07.157070 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:08.157049705 +0000 UTC m=+4.032983068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:07.256594 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.256567 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde330ce3_917a_4067_8725_3c256db3aea1.slice/crio-992fc29b2c47c427b0dbbebac1c12e9d4484226ed9b5072c452e143b4176db36 WatchSource:0}: Error finding container 992fc29b2c47c427b0dbbebac1c12e9d4484226ed9b5072c452e143b4176db36: Status 404 returned error can't find the container with id 992fc29b2c47c427b0dbbebac1c12e9d4484226ed9b5072c452e143b4176db36 Jun 03 00:49:07.257402 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.257186 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:07.257402 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:07.257359 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:07.257402 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:07.257382 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:07.257402 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:07.257395 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:07.257694 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:07.257451 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:08.257430991 +0000 UTC m=+4.133364336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:07.257998 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.257875 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476605e9_d423_4615_b992_89fe786010c7.slice/crio-1655da7d23e9f2288b386bbf41c227f55152bde47de1d2f35dabdc0f0b0e1867 WatchSource:0}: Error finding container 1655da7d23e9f2288b386bbf41c227f55152bde47de1d2f35dabdc0f0b0e1867: Status 404 returned error can't find the container with id 1655da7d23e9f2288b386bbf41c227f55152bde47de1d2f35dabdc0f0b0e1867 Jun 03 00:49:07.259501 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.259329 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ad72da_6266_4888_8008_c0fe1fb7f0f5.slice/crio-7a366446d59c9dcf44a00ed84880dba5e4abadba8da2354e5860f564e59a716d WatchSource:0}: Error finding container 7a366446d59c9dcf44a00ed84880dba5e4abadba8da2354e5860f564e59a716d: Status 404 returned error can't find the container with id 7a366446d59c9dcf44a00ed84880dba5e4abadba8da2354e5860f564e59a716d Jun 03 00:49:07.261143 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.260719 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78fe96a_caf8_4817_8a6c_0bbf324e0e5b.slice/crio-b9afccd88d1812b3a7c5ee33e4b13b24b6b24550a635f9c8c4c63b9f2b675018 WatchSource:0}: Error finding container b9afccd88d1812b3a7c5ee33e4b13b24b6b24550a635f9c8c4c63b9f2b675018: Status 404 returned error can't find the container with id b9afccd88d1812b3a7c5ee33e4b13b24b6b24550a635f9c8c4c63b9f2b675018 Jun 03 00:49:07.263688 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.263657 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f63e690_4583_4353_b39f_6ab08d09e8aa.slice/crio-3559f32e350012b184bb8dcdf52472d41128e8b619501258180f052158f73ab0 WatchSource:0}: Error finding container 3559f32e350012b184bb8dcdf52472d41128e8b619501258180f052158f73ab0: Status 404 returned error can't find the container with id 3559f32e350012b184bb8dcdf52472d41128e8b619501258180f052158f73ab0 Jun 03 00:49:07.264423 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.264401 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079fafe0_a32e_47b9_8a5e_2a1e9a1fcd38.slice/crio-e7a4dee8aa598e7c87cab267d8d26ae9c2ccbf18002e88b920771d7b2eddb3a2 WatchSource:0}: Error finding container e7a4dee8aa598e7c87cab267d8d26ae9c2ccbf18002e88b920771d7b2eddb3a2: Status 404 returned error can't find the container with id e7a4dee8aa598e7c87cab267d8d26ae9c2ccbf18002e88b920771d7b2eddb3a2 Jun 03 00:49:07.265047 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.265022 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc962202c_84d1_454a_9a66_39775fcfb016.slice/crio-b8ff1ff5951949dd9c3a5b1fdcdcf8cb815de2935b81807b05ec7aa086066b59 WatchSource:0}: Error finding container b8ff1ff5951949dd9c3a5b1fdcdcf8cb815de2935b81807b05ec7aa086066b59: Status 404 returned error can't find the container with id b8ff1ff5951949dd9c3a5b1fdcdcf8cb815de2935b81807b05ec7aa086066b59 Jun 03 00:49:07.266346 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.266272 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2a1d08_ecd8_45d7_b5cd_ba036996b8b5.slice/crio-17b792b73846947d25be439666b622d9736dde28a81d7fc448014827faa16789 WatchSource:0}: Error finding container 17b792b73846947d25be439666b622d9736dde28a81d7fc448014827faa16789: Status 404 returned error can't find the container with id 17b792b73846947d25be439666b622d9736dde28a81d7fc448014827faa16789 Jun 03 00:49:07.266959 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:07.266940 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ab151a_f19d_451a_984c_613ce7a8cbb4.slice/crio-fcf592c7612885ad03e482f73f8369738dae0eaa30bc0daa7f8aab666fb76919 WatchSource:0}: Error finding container fcf592c7612885ad03e482f73f8369738dae0eaa30bc0daa7f8aab666fb76919: Status 404 returned error can't find the container with id fcf592c7612885ad03e482f73f8369738dae0eaa30bc0daa7f8aab666fb76919 Jun 03 00:49:07.571612 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.571573 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:44:05 +0000 UTC" deadline="2028-03-06 23:38:23.400958928 +0000 UTC" Jun 03 00:49:07.571929 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.571613 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15430h49m15.829349487s" Jun 03 00:49:07.665019 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.664946 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gx8d" event={"ID":"476605e9-d423-4615-b992-89fe786010c7","Type":"ContainerStarted","Data":"1655da7d23e9f2288b386bbf41c227f55152bde47de1d2f35dabdc0f0b0e1867"} Jun 03 00:49:07.666647 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.666620 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8xzmp" event={"ID":"de330ce3-917a-4067-8725-3c256db3aea1","Type":"ContainerStarted","Data":"992fc29b2c47c427b0dbbebac1c12e9d4484226ed9b5072c452e143b4176db36"} Jun 03 00:49:07.668856 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.668821 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" event={"ID":"8b44d7c0a6240cf94f6a0c54e589f5d9","Type":"ContainerStarted","Data":"ef3aadba2f881933dab50fa2c73bf578ff3afe706bb632967fedb439bb62104d"} Jun 03 00:49:07.672470 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.672029 2570 generic.go:358] "Generic (PLEG): container finished" podID="23b0fa9429d5c156331695346ac085f3" containerID="e8a19f1dae90df10f955517d699638dbd95b5b41c5676b92e6ee4ee307a8b0fd" exitCode=0 Jun 03 00:49:07.672470 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.672396 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" event={"ID":"23b0fa9429d5c156331695346ac085f3","Type":"ContainerDied","Data":"e8a19f1dae90df10f955517d699638dbd95b5b41c5676b92e6ee4ee307a8b0fd"} Jun 03 00:49:07.674146 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.674122 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" event={"ID":"e7ab151a-f19d-451a-984c-613ce7a8cbb4","Type":"ContainerStarted","Data":"fcf592c7612885ad03e482f73f8369738dae0eaa30bc0daa7f8aab666fb76919"} Jun 03 00:49:07.676493 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.676470 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l9k2p" event={"ID":"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5","Type":"ContainerStarted","Data":"17b792b73846947d25be439666b622d9736dde28a81d7fc448014827faa16789"} Jun 03 00:49:07.680823 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.680798 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerStarted","Data":"b8ff1ff5951949dd9c3a5b1fdcdcf8cb815de2935b81807b05ec7aa086066b59"} Jun 03 00:49:07.685864 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.685828 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z6l5m" event={"ID":"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38","Type":"ContainerStarted","Data":"e7a4dee8aa598e7c87cab267d8d26ae9c2ccbf18002e88b920771d7b2eddb3a2"} Jun 03 00:49:07.691856 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.691820 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-130.ec2.internal" podStartSLOduration=2.691808811 podStartE2EDuration="2.691808811s" podCreationTimestamp="2026-06-03 00:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:07.691248057 +0000 UTC m=+3.567181423" watchObservedRunningTime="2026-06-03 00:49:07.691808811 +0000 UTC m=+3.567742177" Jun 03 00:49:07.692621 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.692570 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bft57" event={"ID":"2f63e690-4583-4353-b39f-6ab08d09e8aa","Type":"ContainerStarted","Data":"3559f32e350012b184bb8dcdf52472d41128e8b619501258180f052158f73ab0"} Jun 03 00:49:07.695763 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.695740 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"b9afccd88d1812b3a7c5ee33e4b13b24b6b24550a635f9c8c4c63b9f2b675018"} Jun 03 00:49:07.697915 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:07.697892 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" event={"ID":"37ad72da-6266-4888-8008-c0fe1fb7f0f5","Type":"ContainerStarted","Data":"7a366446d59c9dcf44a00ed84880dba5e4abadba8da2354e5860f564e59a716d"} Jun 03 00:49:08.168410 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:08.168316 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:08.168639 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.168493 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:08.168639 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.168575 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:10.168556897 +0000 UTC m=+6.044490248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:08.271360 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:08.270607 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:08.271360 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.270799 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:08.271360 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.270821 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:08.271360 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.270835 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:08.271360 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.270915 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:10.270895144 +0000 UTC m=+6.146828488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:08.655696 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:08.652324 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:08.655696 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.652447 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:08.655696 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:08.652990 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:08.655696 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:08.653136 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:08.716270 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:08.716226 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" event={"ID":"23b0fa9429d5c156331695346ac085f3","Type":"ContainerStarted","Data":"414818e348b07d89504843713f7f6851a630adeb1f893f442aee9e6d0ef5e9c6"} Jun 03 00:49:08.732703 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:08.732647 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-130.ec2.internal" podStartSLOduration=3.7326294300000002 podStartE2EDuration="3.73262943s" podCreationTimestamp="2026-06-03 00:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:08.731196841 +0000 UTC m=+4.607130209" watchObservedRunningTime="2026-06-03 00:49:08.73262943 +0000 UTC m=+4.608562799" Jun 03 00:49:10.188269 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:10.187776 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:10.188269 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.187883 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:10.188269 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.187932 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:14.187919174 +0000 UTC m=+10.063852519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:10.289338 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:10.288691 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:10.289338 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.288892 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:10.289338 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.288911 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:10.289338 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.288924 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:10.289338 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.288984 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:14.288962812 +0000 UTC m=+10.164896162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:10.651966 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:10.651883 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:10.652140 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.652005 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:10.652573 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:10.652391 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:10.652573 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:10.652532 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:12.656679 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:12.656024 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:12.656679 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:12.656148 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:12.656679 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:12.656542 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:12.656679 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:12.656643 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:14.221750 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:14.221709 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:14.222236 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.221895 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:14.222236 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.221979 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:22.221952912 +0000 UTC m=+18.097886259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:14.322479 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:14.322435 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:14.322652 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.322633 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:14.322726 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.322660 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:14.322726 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.322675 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:14.322812 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.322740 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:22.322720823 +0000 UTC m=+18.198654172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:14.656424 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:14.656340 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:14.656585 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.656478 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:14.656585 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:14.656340 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:14.656685 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:14.656627 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:16.655277 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:16.655239 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:16.655773 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:16.655248 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:16.655773 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:16.655365 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:16.655773 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:16.655432 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:18.652352 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:18.652317 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:18.652352 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:18.652349 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:18.652858 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:18.652436 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:18.652858 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:18.652586 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:20.655101 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:20.655068 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:20.655557 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:20.655206 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:20.655557 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:20.655242 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:20.655557 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:20.655313 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:22.278982 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:22.278945 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:22.279428 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.279106 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:22.279428 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.279182 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:38.279165909 +0000 UTC m=+34.155099256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:22.380355 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:22.380310 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:22.380562 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.380512 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:22.380562 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.380556 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:22.380679 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.380571 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:22.380679 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.380631 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:38.380616079 +0000 UTC m=+34.256549427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:22.651925 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:22.651840 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:22.652109 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:22.651840 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:22.652109 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.651980 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:22.652109 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:22.652076 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:24.652966 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:24.652915 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:24.653496 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:24.653011 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:24.653496 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:24.653097 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:24.653496 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:24.653237 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:26.652688 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.652322 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:26.653325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.652330 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:26.653325 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:26.652803 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:26.653325 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:26.652877 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:26.748036 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.748004 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 00:49:26.750767 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.750743 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" event={"ID":"e7ab151a-f19d-451a-984c-613ce7a8cbb4","Type":"ContainerStarted","Data":"6b99e497216541f2c50b1d4758eb96d16913bb499dab919f1b12c1ff29b84be4"} Jun 03 00:49:26.750854 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.750776 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" event={"ID":"e7ab151a-f19d-451a-984c-613ce7a8cbb4","Type":"ContainerStarted","Data":"f1a8e8653197d6070725b8528a90e5f16215d86a4c1aa9c8a4175549ba704fbc"} Jun 03 00:49:26.751888 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.751867 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l9k2p" event={"ID":"0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5","Type":"ContainerStarted","Data":"bdeeba93d4a2cf304c107db4d487c992e83887c224293ca6f187f897cdac685f"} Jun 03 00:49:26.753105 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.753086 2570 generic.go:358] "Generic (PLEG): container finished" podID="c962202c-84d1-454a-9a66-39775fcfb016" containerID="4fb82915c9ff5c023b286f129769e7c5f33010624d9bd9b4f9c603055ee9b619" exitCode=0 Jun 03 00:49:26.753167 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.753140 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerDied","Data":"4fb82915c9ff5c023b286f129769e7c5f33010624d9bd9b4f9c603055ee9b619"} Jun 03 00:49:26.754401 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.754375 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z6l5m" event={"ID":"079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38","Type":"ContainerStarted","Data":"6330be528d5a1c36f0568bcd6cae6756e6eb9b830288f3ee8279381202278274"} Jun 03 00:49:26.757169 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.757149 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"b4336078235bd6c0134616bf6ed3c780d4723ea0fd9eb3c2c2f73fe0e048c97e"} Jun 03 00:49:26.757248 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.757192 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"2492290ea792ba49d4dd96de3508bdc49f436409bbd4412083e1e10a04aeaf24"} Jun 03 00:49:26.757248 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.757202 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"036b4cedbe24d70c43f0936fb4e653d646e0a56fae0697b662df3af570c3a412"} Jun 03 00:49:26.757248 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.757210 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"d15e51c68fdf31466e721fff472bb8e86568e030cbcb17b5afa80ea2f75f9ae8"} Jun 03 00:49:26.757248 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.757218 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"d4a5d29db3863c40222975e8857b27c49c2ba9f37b74d5939dc227750e249cb2"} Jun 03 00:49:26.757248 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.757225 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"26aa2ad1415d927864e577f99f809acccd15b25f0d90abb8d2134941882bd1bd"} Jun 03 00:49:26.758311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.758291 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" event={"ID":"37ad72da-6266-4888-8008-c0fe1fb7f0f5","Type":"ContainerStarted","Data":"11571b12f4752d14fdcb1759285fbf1c0636881ba3f7c0a78c5a969321f6bcbb"} Jun 03 00:49:26.759448 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.759426 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gx8d" event={"ID":"476605e9-d423-4615-b992-89fe786010c7","Type":"ContainerStarted","Data":"83fb6282b3f553867defa15fbfb8b2485363c749bb9d9a5ae19a86dd2f909ca3"} Jun 03 00:49:26.760461 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.760441 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8xzmp" event={"ID":"de330ce3-917a-4067-8725-3c256db3aea1","Type":"ContainerStarted","Data":"05dff3d53113a3560e9d67808c1529449f5a96a6475713371a781e7ffe55332d"} Jun 03 00:49:26.765246 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.765207 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l9k2p" podStartSLOduration=9.166841317 podStartE2EDuration="22.765197839s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.268081621 +0000 UTC m=+3.144014968" lastFinishedPulling="2026-06-03 00:49:20.866438132 +0000 UTC m=+16.742371490" observedRunningTime="2026-06-03 00:49:26.764643291 +0000 UTC m=+22.640576659" watchObservedRunningTime="2026-06-03 00:49:26.765197839 +0000 UTC m=+22.641131204" Jun 03 00:49:26.779532 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.779475 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2gx8d" podStartSLOduration=4.301953364 podStartE2EDuration="22.779464659s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.259509415 +0000 UTC m=+3.135442759" lastFinishedPulling="2026-06-03 00:49:25.737020709 +0000 UTC m=+21.612954054" observedRunningTime="2026-06-03 00:49:26.77912323 +0000 UTC m=+22.655056599" watchObservedRunningTime="2026-06-03 00:49:26.779464659 +0000 UTC m=+22.655398024" Jun 03 00:49:26.796275 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.794337 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8xzmp" podStartSLOduration=4.353734829 podStartE2EDuration="22.794323216s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.258262002 +0000 UTC m=+3.134195349" lastFinishedPulling="2026-06-03 00:49:25.698850389 +0000 UTC m=+21.574783736" observedRunningTime="2026-06-03 00:49:26.79378357 +0000 UTC m=+22.669716936" watchObservedRunningTime="2026-06-03 00:49:26.794323216 +0000 UTC m=+22.670256583" Jun 03 00:49:26.822258 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.822215 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z6l5m" podStartSLOduration=4.357290454 podStartE2EDuration="22.822204397s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.266044556 +0000 UTC m=+3.141977914" lastFinishedPulling="2026-06-03 00:49:25.7309585 +0000 UTC m=+21.606891857" observedRunningTime="2026-06-03 00:49:26.822132569 +0000 UTC m=+22.698065935" watchObservedRunningTime="2026-06-03 00:49:26.822204397 +0000 UTC m=+22.698137763" Jun 03 00:49:26.822348 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:26.822282 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f6lpf" podStartSLOduration=4.350764577 podStartE2EDuration="22.822278265s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.261784081 +0000 UTC m=+3.137717432" lastFinishedPulling="2026-06-03 00:49:25.733297776 +0000 UTC m=+21.609231120" observedRunningTime="2026-06-03 00:49:26.809570534 +0000 UTC m=+22.685503897" watchObservedRunningTime="2026-06-03 00:49:26.822278265 +0000 UTC m=+22.698211631" Jun 03 00:49:27.611934 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.611738 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T00:49:26.748031378Z","UUID":"e72f8006-3ca8-40cb-89ad-be6e0c99349f","Handler":null,"Name":"","Endpoint":""} Jun 03 00:49:27.618892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.618865 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 00:49:27.618892 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.618899 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 00:49:27.764219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.764013 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" event={"ID":"e7ab151a-f19d-451a-984c-613ce7a8cbb4","Type":"ContainerStarted","Data":"39241f3a889576347360f4bd5e0b98242124eef8f846792e24f4e9cc745ccbe4"} Jun 03 00:49:27.765264 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.765237 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bft57" event={"ID":"2f63e690-4583-4353-b39f-6ab08d09e8aa","Type":"ContainerStarted","Data":"50a1d5362b0f082325cca1367b5b5726f9154a68d4181aac88dc6f254b503488"} Jun 03 00:49:27.779928 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.779888 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgz2d" podStartSLOduration=3.471086707 podStartE2EDuration="23.779875765s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.268660869 +0000 UTC m=+3.144594225" lastFinishedPulling="2026-06-03 00:49:27.577449939 +0000 UTC m=+23.453383283" observedRunningTime="2026-06-03 00:49:27.779683773 +0000 UTC m=+23.655617140" watchObservedRunningTime="2026-06-03 00:49:27.779875765 +0000 UTC m=+23.655809131" Jun 03 00:49:27.793598 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:27.793559 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bft57" podStartSLOduration=10.192443396 podStartE2EDuration="23.793546041s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.26534189 +0000 UTC m=+3.141275247" lastFinishedPulling="2026-06-03 00:49:20.866444548 +0000 UTC m=+16.742377892" observedRunningTime="2026-06-03 00:49:27.79311425 +0000 UTC m=+23.669047610" watchObservedRunningTime="2026-06-03 00:49:27.793546041 +0000 UTC m=+23.669479408" Jun 03 00:49:28.652565 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:28.652458 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:28.652748 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:28.652577 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:28.652748 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:28.652633 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:28.652748 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:28.652732 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:28.769341 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:28.769296 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"4b8f11c8b5805c68aa383453a9be9b0bdccec20cbb4d23750c568912a0566606"} Jun 03 00:49:28.901325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:28.901293 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:28.901966 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:28.901947 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:29.771241 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:29.771213 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:29.771912 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:29.771796 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z6l5m" Jun 03 00:49:30.652092 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:30.652030 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:30.652284 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:30.652158 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:30.652284 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:30.652218 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:30.652370 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:30.652325 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:31.777729 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:31.777469 2570 generic.go:358] "Generic (PLEG): container finished" podID="c962202c-84d1-454a-9a66-39775fcfb016" containerID="e07116b6928f759af9da7ed81c03d92526120cc00743805778bc5a0a375108ca" exitCode=0 Jun 03 00:49:31.777729 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:31.777622 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerDied","Data":"e07116b6928f759af9da7ed81c03d92526120cc00743805778bc5a0a375108ca"} Jun 03 00:49:31.780825 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:31.780800 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" event={"ID":"a78fe96a-caf8-4817-8a6c-0bbf324e0e5b","Type":"ContainerStarted","Data":"d11334f38c1b41a26e70842b68f528bd4fb84a0dc2322c14470788f4baa3f132"} Jun 03 00:49:31.781080 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:31.781062 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:31.797782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:31.797750 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:31.829361 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:31.829305 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" podStartSLOduration=9.314151061 podStartE2EDuration="27.829291104s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.262578764 +0000 UTC m=+3.138512110" lastFinishedPulling="2026-06-03 00:49:25.777718805 +0000 UTC m=+21.653652153" observedRunningTime="2026-06-03 00:49:31.826648119 +0000 UTC m=+27.702581486" watchObservedRunningTime="2026-06-03 00:49:31.829291104 +0000 UTC m=+27.705224470" Jun 03 00:49:32.652023 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:32.651990 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:32.652616 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:32.652112 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:32.652616 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:32.652171 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:32.652616 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:32.652308 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:32.782627 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:32.782601 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 00:49:32.783042 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:32.782951 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:32.798468 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:32.798444 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:33.244739 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.244481 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nrlbr"] Jun 03 00:49:33.244895 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.244773 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:33.244895 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:33.244878 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:33.245046 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.245020 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hgll5"] Jun 03 00:49:33.245126 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.245113 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:33.245213 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:33.245195 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:33.786190 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.786160 2570 generic.go:358] "Generic (PLEG): container finished" podID="c962202c-84d1-454a-9a66-39775fcfb016" containerID="a19a4c7d809c737106361b79fcb62572d75bcf90bd498ca9826b96b8f0c34974" exitCode=0 Jun 03 00:49:33.786584 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.786251 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerDied","Data":"a19a4c7d809c737106361b79fcb62572d75bcf90bd498ca9826b96b8f0c34974"} Jun 03 00:49:33.786584 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:33.786329 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 00:49:34.653461 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:34.653427 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:34.653641 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:34.653580 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:34.653641 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:34.653609 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:34.653759 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:34.653704 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:34.790076 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:34.790052 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 00:49:35.791402 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:35.791370 2570 generic.go:358] "Generic (PLEG): container finished" podID="c962202c-84d1-454a-9a66-39775fcfb016" containerID="09ce2562ad7fdf6bebfc13816500d4955ac70a6af36d0398b31d0a747fecc9b3" exitCode=0 Jun 03 00:49:35.792054 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:35.791437 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerDied","Data":"09ce2562ad7fdf6bebfc13816500d4955ac70a6af36d0398b31d0a747fecc9b3"} Jun 03 00:49:36.100372 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.100274 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:49:36.100558 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.100500 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 00:49:36.117200 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.117158 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" podUID="a78fe96a-caf8-4817-8a6c-0bbf324e0e5b" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 00:49:36.126391 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.126350 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" podUID="a78fe96a-caf8-4817-8a6c-0bbf324e0e5b" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 00:49:36.652209 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.652175 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:36.652359 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.652215 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:36.652359 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:36.652319 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgll5" podUID="95a165fd-418f-4a8e-9a5f-f90601e2de34" Jun 03 00:49:36.652470 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:36.652443 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlbr" podUID="ee87d98c-44ad-43c2-8509-1d4087086c3f" Jun 03 00:49:36.890955 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:36.890925 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8xzmp_de330ce3-917a-4067-8725-3c256db3aea1/dns-node-resolver/0.log" Jun 03 00:49:37.875093 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:37.875061 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l9k2p_0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5/node-ca/0.log" Jun 03 00:49:38.298083 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.298054 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:38.298635 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.298198 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:38.298635 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.298276 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs podName:ee87d98c-44ad-43c2-8509-1d4087086c3f nodeName:}" failed. No retries permitted until 2026-06-03 00:50:10.298255974 +0000 UTC m=+66.174189321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs") pod "network-metrics-daemon-nrlbr" (UID: "ee87d98c-44ad-43c2-8509-1d4087086c3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:38.399311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.399271 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:38.399498 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.399441 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:38.399498 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.399461 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:38.399498 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.399472 2570 projected.go:194] Error preparing data for projected volume kube-api-access-bf4qv for pod openshift-network-diagnostics/network-check-target-hgll5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:38.399699 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.399547 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv podName:95a165fd-418f-4a8e-9a5f-f90601e2de34 nodeName:}" failed. No retries permitted until 2026-06-03 00:50:10.399512696 +0000 UTC m=+66.275446048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf4qv" (UniqueName: "kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv") pod "network-check-target-hgll5" (UID: "95a165fd-418f-4a8e-9a5f-f90601e2de34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:38.444688 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.444652 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-130.ec2.internal" event="NodeReady" Jun 03 00:49:38.444861 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.444811 2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 00:49:38.489343 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.489303 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4gqbs"] Jun 03 00:49:38.510830 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.510789 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jjwc4"] Jun 03 00:49:38.510995 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.510967 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.514068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.514044 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 00:49:38.514505 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.514484 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 00:49:38.515473 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.515452 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9sxhx\"" Jun 03 00:49:38.532499 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.532470 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4gqbs"] Jun 03 00:49:38.532665 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.532507 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p2s5p"] Jun 03 00:49:38.532665 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.532605 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.537251 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.537229 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crjds\"" Jun 03 00:49:38.537548 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.537510 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 00:49:38.537717 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.537670 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 00:49:38.537824 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.537725 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 00:49:38.537824 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.537671 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 00:49:38.557761 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.557688 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjwc4"] Jun 03 00:49:38.557761 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.557719 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p2s5p"] Jun 03 00:49:38.557961 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.557841 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:38.561353 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.561330 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 00:49:38.561481 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.561362 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 00:49:38.561481 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.561437 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 00:49:38.561481 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.561437 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-skfr9\"" Jun 03 00:49:38.601033 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.601001 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwft5\" (UniqueName: \"kubernetes.io/projected/2efe21ed-376a-4b69-8b1d-2ce240a24c20-kube-api-access-lwft5\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.601188 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.601046 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2efe21ed-376a-4b69-8b1d-2ce240a24c20-config-volume\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.601188 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.601074 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.601188 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.601100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2efe21ed-376a-4b69-8b1d-2ce240a24c20-tmp-dir\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.607728 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.607696 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-rkqtt"] Jun 03 00:49:38.628851 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.628823 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-rkqtt"] Jun 03 00:49:38.629013 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.628961 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.632393 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.632369 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 00:49:38.632393 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.632384 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 00:49:38.632585 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.632572 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 00:49:38.632740 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.632724 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jzlhh\"" Jun 03 00:49:38.632803 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.632791 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 00:49:38.652783 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.652758 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:49:38.652894 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.652763 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:49:38.655406 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.655386 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:49:38.655857 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.655628 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:49:38.655857 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.655670 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vkdv\"" Jun 03 00:49:38.655857 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.655726 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:49:38.655857 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.655796 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wvk5\"" Jun 03 00:49:38.701557 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701501 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxdq\" (UniqueName: \"kubernetes.io/projected/ee7a80ff-428c-4cd5-835b-caa8149a5931-kube-api-access-mkxdq\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.701688 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6c7r\" (UniqueName: \"kubernetes.io/projected/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-kube-api-access-k6c7r\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:38.701688 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701674 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwft5\" (UniqueName: \"kubernetes.io/projected/2efe21ed-376a-4b69-8b1d-2ce240a24c20-kube-api-access-lwft5\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.701800 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701711 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.701800 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701739 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:38.701886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701805 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2efe21ed-376a-4b69-8b1d-2ce240a24c20-config-volume\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.701886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701842 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.701886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701874 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2efe21ed-376a-4b69-8b1d-2ce240a24c20-tmp-dir\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.702002 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701908 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee7a80ff-428c-4cd5-835b-caa8149a5931-data-volume\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.702002 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee7a80ff-428c-4cd5-835b-caa8149a5931-crio-socket\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.702002 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.701966 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:38.702002 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.701982 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7a80ff-428c-4cd5-835b-caa8149a5931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.702144 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.702037 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls podName:2efe21ed-376a-4b69-8b1d-2ce240a24c20 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.202017093 +0000 UTC m=+35.077950456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls") pod "dns-default-4gqbs" (UID: "2efe21ed-376a-4b69-8b1d-2ce240a24c20") : secret "dns-default-metrics-tls" not found Jun 03 00:49:38.702304 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.702283 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2efe21ed-376a-4b69-8b1d-2ce240a24c20-tmp-dir\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.702501 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.702483 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2efe21ed-376a-4b69-8b1d-2ce240a24c20-config-volume\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.712546 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.712506 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwft5\" (UniqueName: \"kubernetes.io/projected/2efe21ed-376a-4b69-8b1d-2ce240a24c20-kube-api-access-lwft5\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:38.803115 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803081 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee7a80ff-428c-4cd5-835b-caa8149a5931-data-volume\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.803311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/70ccbace-7e82-4f21-901f-0f722c4f12f5-signing-key\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.803311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803166 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee7a80ff-428c-4cd5-835b-caa8149a5931-crio-socket\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.803311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803183 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7a80ff-428c-4cd5-835b-caa8149a5931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.803311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803205 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxdq\" (UniqueName: \"kubernetes.io/projected/ee7a80ff-428c-4cd5-835b-caa8149a5931-kube-api-access-mkxdq\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.803311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803226 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6c7r\" (UniqueName: \"kubernetes.io/projected/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-kube-api-access-k6c7r\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:38.803311 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvz8\" (UniqueName: \"kubernetes.io/projected/70ccbace-7e82-4f21-901f-0f722c4f12f5-kube-api-access-hcvz8\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803319 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803343 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.803392 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/70ccbace-7e82-4f21-901f-0f722c4f12f5-signing-cabundle\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.803691 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.803760 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert podName:03ac9623-ed75-4cf3-a0f8-87cb3a8a5892 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.303738131 +0000 UTC m=+35.179671479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert") pod "ingress-canary-p2s5p" (UID: "03ac9623-ed75-4cf3-a0f8-87cb3a8a5892") : secret "canary-serving-cert" not found Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.803791 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:38.803904 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls podName:ee7a80ff-428c-4cd5-835b-caa8149a5931 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.303883111 +0000 UTC m=+35.179816458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjwc4" (UID: "ee7a80ff-428c-4cd5-835b-caa8149a5931") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.804025 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee7a80ff-428c-4cd5-835b-caa8149a5931-data-volume\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.804034 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee7a80ff-428c-4cd5-835b-caa8149a5931-crio-socket\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.804333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.804133 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7a80ff-428c-4cd5-835b-caa8149a5931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.813562 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.813484 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxdq\" (UniqueName: \"kubernetes.io/projected/ee7a80ff-428c-4cd5-835b-caa8149a5931-kube-api-access-mkxdq\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:38.813808 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.813790 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6c7r\" (UniqueName: \"kubernetes.io/projected/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-kube-api-access-k6c7r\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:38.904768 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.904582 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/70ccbace-7e82-4f21-901f-0f722c4f12f5-signing-cabundle\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.904954 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.904796 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/70ccbace-7e82-4f21-901f-0f722c4f12f5-signing-key\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.904954 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.904829 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvz8\" (UniqueName: \"kubernetes.io/projected/70ccbace-7e82-4f21-901f-0f722c4f12f5-kube-api-access-hcvz8\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.905385 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.905357 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/70ccbace-7e82-4f21-901f-0f722c4f12f5-signing-cabundle\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.907932 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.907904 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/70ccbace-7e82-4f21-901f-0f722c4f12f5-signing-key\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.919503 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.919477 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvz8\" (UniqueName: \"kubernetes.io/projected/70ccbace-7e82-4f21-901f-0f722c4f12f5-kube-api-access-hcvz8\") pod \"service-ca-685df94d57-rkqtt\" (UID: \"70ccbace-7e82-4f21-901f-0f722c4f12f5\") " pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:38.940258 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:38.940230 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-rkqtt" Jun 03 00:49:39.113638 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:39.113606 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-rkqtt"] Jun 03 00:49:39.119864 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:39.119836 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ccbace_7e82_4f21_901f_0f722c4f12f5.slice/crio-5ca493aa8d103aa90621eed466cdd06814fb207f79f38fb78f49e31c0c9dc564 WatchSource:0}: Error finding container 5ca493aa8d103aa90621eed466cdd06814fb207f79f38fb78f49e31c0c9dc564: Status 404 returned error can't find the container with id 5ca493aa8d103aa90621eed466cdd06814fb207f79f38fb78f49e31c0c9dc564 Jun 03 00:49:39.208309 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:39.208273 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:39.208481 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:39.208436 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:39.208553 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:39.208505 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls podName:2efe21ed-376a-4b69-8b1d-2ce240a24c20 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:40.208489384 +0000 UTC m=+36.084422731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls") pod "dns-default-4gqbs" (UID: "2efe21ed-376a-4b69-8b1d-2ce240a24c20") : secret "dns-default-metrics-tls" not found Jun 03 00:49:39.309133 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:39.309096 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:39.309133 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:39.309129 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:39.309605 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:39.309226 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:39.309605 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:39.309240 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:39.309605 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:39.309287 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert podName:03ac9623-ed75-4cf3-a0f8-87cb3a8a5892 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:40.309272427 +0000 UTC m=+36.185205774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert") pod "ingress-canary-p2s5p" (UID: "03ac9623-ed75-4cf3-a0f8-87cb3a8a5892") : secret "canary-serving-cert" not found Jun 03 00:49:39.309605 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:39.309301 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls podName:ee7a80ff-428c-4cd5-835b-caa8149a5931 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:40.309295357 +0000 UTC m=+36.185228702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjwc4" (UID: "ee7a80ff-428c-4cd5-835b-caa8149a5931") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:39.801331 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:39.801286 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-rkqtt" event={"ID":"70ccbace-7e82-4f21-901f-0f722c4f12f5","Type":"ContainerStarted","Data":"5ca493aa8d103aa90621eed466cdd06814fb207f79f38fb78f49e31c0c9dc564"} Jun 03 00:49:40.216839 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:40.216804 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:40.217115 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:40.216966 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:40.217115 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:40.217059 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls podName:2efe21ed-376a-4b69-8b1d-2ce240a24c20 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:42.217029731 +0000 UTC m=+38.092963098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls") pod "dns-default-4gqbs" (UID: "2efe21ed-376a-4b69-8b1d-2ce240a24c20") : secret "dns-default-metrics-tls" not found Jun 03 00:49:40.318084 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:40.318045 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:40.318084 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:40.318085 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:40.318635 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:40.318197 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:40.318635 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:40.318205 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:40.318635 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:40.318254 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert podName:03ac9623-ed75-4cf3-a0f8-87cb3a8a5892 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:42.318240081 +0000 UTC m=+38.194173434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert") pod "ingress-canary-p2s5p" (UID: "03ac9623-ed75-4cf3-a0f8-87cb3a8a5892") : secret "canary-serving-cert" not found Jun 03 00:49:40.318635 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:40.318267 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls podName:ee7a80ff-428c-4cd5-835b-caa8149a5931 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:42.318260835 +0000 UTC m=+38.194194178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjwc4" (UID: "ee7a80ff-428c-4cd5-835b-caa8149a5931") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:42.232974 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:42.232905 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:42.233466 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:42.233093 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:42.233466 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:42.233174 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls podName:2efe21ed-376a-4b69-8b1d-2ce240a24c20 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:46.233156822 +0000 UTC m=+42.109090167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls") pod "dns-default-4gqbs" (UID: "2efe21ed-376a-4b69-8b1d-2ce240a24c20") : secret "dns-default-metrics-tls" not found Jun 03 00:49:42.333534 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:42.333484 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:42.333534 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:42.333542 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:42.333754 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:42.333642 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:42.333754 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:42.333644 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:42.333754 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:42.333700 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert podName:03ac9623-ed75-4cf3-a0f8-87cb3a8a5892 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:46.333688012 +0000 UTC m=+42.209621355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert") pod "ingress-canary-p2s5p" (UID: "03ac9623-ed75-4cf3-a0f8-87cb3a8a5892") : secret "canary-serving-cert" not found Jun 03 00:49:42.333754 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:42.333714 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls podName:ee7a80ff-428c-4cd5-835b-caa8149a5931 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:46.333707097 +0000 UTC m=+42.209640441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjwc4" (UID: "ee7a80ff-428c-4cd5-835b-caa8149a5931") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:42.811268 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:42.811070 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerStarted","Data":"d4285f23ab481206b0553fe0aeae328131fcea644ce150573c52d518df1eeb5d"} Jun 03 00:49:42.812364 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:42.812341 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-rkqtt" event={"ID":"70ccbace-7e82-4f21-901f-0f722c4f12f5","Type":"ContainerStarted","Data":"53439d8fb6340a98c0c9cfd9eff64ed444c41577ff91f9a620122d8002a9e499"} Jun 03 00:49:43.816201 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:43.816162 2570 generic.go:358] "Generic (PLEG): container finished" podID="c962202c-84d1-454a-9a66-39775fcfb016" containerID="d4285f23ab481206b0553fe0aeae328131fcea644ce150573c52d518df1eeb5d" exitCode=0 Jun 03 00:49:43.816771 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:43.816254 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerDied","Data":"d4285f23ab481206b0553fe0aeae328131fcea644ce150573c52d518df1eeb5d"} Jun 03 00:49:43.839504 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:43.839453 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-rkqtt" podStartSLOduration=2.410186037 podStartE2EDuration="5.839435818s" podCreationTimestamp="2026-06-03 00:49:38 +0000 UTC" firstStartedPulling="2026-06-03 00:49:39.121769499 +0000 UTC m=+34.997702843" lastFinishedPulling="2026-06-03 00:49:42.551019267 +0000 UTC m=+38.426952624" observedRunningTime="2026-06-03 00:49:42.848498639 +0000 UTC m=+38.724432006" watchObservedRunningTime="2026-06-03 00:49:43.839435818 +0000 UTC m=+39.715369184" Jun 03 00:49:44.821228 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:44.821188 2570 generic.go:358] "Generic (PLEG): container finished" podID="c962202c-84d1-454a-9a66-39775fcfb016" containerID="5daca1ffac89122d961b66d84415d920e7a6a87079a059aef3acf554901d525c" exitCode=0 Jun 03 00:49:44.821814 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:44.821256 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerDied","Data":"5daca1ffac89122d961b66d84415d920e7a6a87079a059aef3acf554901d525c"} Jun 03 00:49:45.826012 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:45.825975 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" event={"ID":"c962202c-84d1-454a-9a66-39775fcfb016","Type":"ContainerStarted","Data":"1af5f6889850fdf5ddf0ded2232ba6d69fdd4820facc56792e7b60cfb2c04051"} Jun 03 00:49:45.850026 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:45.849977 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9n4fh" podStartSLOduration=6.557913565 podStartE2EDuration="41.849964034s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:07.26724604 +0000 UTC m=+3.143179384" lastFinishedPulling="2026-06-03 00:49:42.55929651 +0000 UTC m=+38.435229853" observedRunningTime="2026-06-03 00:49:45.848467479 +0000 UTC m=+41.724400845" watchObservedRunningTime="2026-06-03 00:49:45.849964034 +0000 UTC m=+41.725897401" Jun 03 00:49:46.261400 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:46.261368 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:46.261579 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:46.261538 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:46.261622 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:46.261601 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls podName:2efe21ed-376a-4b69-8b1d-2ce240a24c20 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:54.261586147 +0000 UTC m=+50.137519492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls") pod "dns-default-4gqbs" (UID: "2efe21ed-376a-4b69-8b1d-2ce240a24c20") : secret "dns-default-metrics-tls" not found Jun 03 00:49:46.362152 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:46.362118 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:46.362152 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:46.362154 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:46.362345 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:46.362270 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:46.362345 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:46.362282 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:46.362345 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:46.362331 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls podName:ee7a80ff-428c-4cd5-835b-caa8149a5931 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:54.362316151 +0000 UTC m=+50.238249495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjwc4" (UID: "ee7a80ff-428c-4cd5-835b-caa8149a5931") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:46.362345 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:49:46.362345 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert podName:03ac9623-ed75-4cf3-a0f8-87cb3a8a5892 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:54.362338563 +0000 UTC m=+50.238271907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert") pod "ingress-canary-p2s5p" (UID: "03ac9623-ed75-4cf3-a0f8-87cb3a8a5892") : secret "canary-serving-cert" not found Jun 03 00:49:54.322896 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.322849 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:54.326831 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.326806 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2efe21ed-376a-4b69-8b1d-2ce240a24c20-metrics-tls\") pod \"dns-default-4gqbs\" (UID: \"2efe21ed-376a-4b69-8b1d-2ce240a24c20\") " pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:54.422378 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.422333 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:54.423382 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.423156 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:54.423382 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.423191 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:54.425594 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.425572 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7a80ff-428c-4cd5-835b-caa8149a5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjwc4\" (UID: \"ee7a80ff-428c-4cd5-835b-caa8149a5931\") " pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:54.425726 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.425703 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ac9623-ed75-4cf3-a0f8-87cb3a8a5892-cert\") pod \"ingress-canary-p2s5p\" (UID: \"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892\") " pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:54.442318 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.442286 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjwc4" Jun 03 00:49:54.472274 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.472243 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p2s5p" Jun 03 00:49:54.599745 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.599711 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4gqbs"] Jun 03 00:49:54.605739 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:54.605696 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efe21ed_376a_4b69_8b1d_2ce240a24c20.slice/crio-7c89f91383d31dd5c955402404067637a432bcdc6403dd57ca221972561f7db0 WatchSource:0}: Error finding container 7c89f91383d31dd5c955402404067637a432bcdc6403dd57ca221972561f7db0: Status 404 returned error can't find the container with id 7c89f91383d31dd5c955402404067637a432bcdc6403dd57ca221972561f7db0 Jun 03 00:49:54.616597 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.616571 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjwc4"] Jun 03 00:49:54.620240 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:54.620209 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7a80ff_428c_4cd5_835b_caa8149a5931.slice/crio-9a3726cdd9dad92b9a99af6221f4360488d301bb701c32434b302bda0e9eb95e WatchSource:0}: Error finding container 9a3726cdd9dad92b9a99af6221f4360488d301bb701c32434b302bda0e9eb95e: Status 404 returned error can't find the container with id 9a3726cdd9dad92b9a99af6221f4360488d301bb701c32434b302bda0e9eb95e Jun 03 00:49:54.646249 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.646225 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p2s5p"] Jun 03 00:49:54.649302 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:54.649275 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ac9623_ed75_4cf3_a0f8_87cb3a8a5892.slice/crio-c4319d2828c7f83a36740be0242556f2402504809f95324a0c6cfe84b6195189 WatchSource:0}: Error finding container c4319d2828c7f83a36740be0242556f2402504809f95324a0c6cfe84b6195189: Status 404 returned error can't find the container with id c4319d2828c7f83a36740be0242556f2402504809f95324a0c6cfe84b6195189 Jun 03 00:49:54.844347 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.844298 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p2s5p" event={"ID":"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892","Type":"ContainerStarted","Data":"c4319d2828c7f83a36740be0242556f2402504809f95324a0c6cfe84b6195189"} Jun 03 00:49:54.845272 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.845245 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gqbs" event={"ID":"2efe21ed-376a-4b69-8b1d-2ce240a24c20","Type":"ContainerStarted","Data":"7c89f91383d31dd5c955402404067637a432bcdc6403dd57ca221972561f7db0"} Jun 03 00:49:54.846435 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.846385 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjwc4" event={"ID":"ee7a80ff-428c-4cd5-835b-caa8149a5931","Type":"ContainerStarted","Data":"1c4406d044771a89dd042f438952ef83b1468a6af71318dd1e6a0dba29999570"} Jun 03 00:49:54.846435 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:54.846408 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjwc4" event={"ID":"ee7a80ff-428c-4cd5-835b-caa8149a5931","Type":"ContainerStarted","Data":"9a3726cdd9dad92b9a99af6221f4360488d301bb701c32434b302bda0e9eb95e"} Jun 03 00:49:55.849776 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:55.849742 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjwc4" event={"ID":"ee7a80ff-428c-4cd5-835b-caa8149a5931","Type":"ContainerStarted","Data":"1daa06aa2101a4ad0bd9ec7174174e3b718f624d2e486ee239de804933dd8044"} Jun 03 00:49:57.858165 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:57.858085 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gqbs" event={"ID":"2efe21ed-376a-4b69-8b1d-2ce240a24c20","Type":"ContainerStarted","Data":"e76c9d07816112cc3fb9b87560944d5c4041c6787133ba28da654e74b57aac0b"} Jun 03 00:49:57.858165 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:57.858136 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gqbs" event={"ID":"2efe21ed-376a-4b69-8b1d-2ce240a24c20","Type":"ContainerStarted","Data":"7f6c9102ee9de419d84964a41ee8f06b1a95ee11df5a46b11595dde5a1669a3e"} Jun 03 00:49:57.861842 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:57.861808 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p2s5p" event={"ID":"03ac9623-ed75-4cf3-a0f8-87cb3a8a5892","Type":"ContainerStarted","Data":"c0e24bc85cf510fe61b90c5f1300a09eecc6f75f1c6866b73e9d45664603dd5e"} Jun 03 00:49:57.871299 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:57.871275 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4gqbs" Jun 03 00:49:57.887424 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:57.887384 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4gqbs" podStartSLOduration=17.581760083 podStartE2EDuration="19.887371858s" podCreationTimestamp="2026-06-03 00:49:38 +0000 UTC" firstStartedPulling="2026-06-03 00:49:54.607332652 +0000 UTC m=+50.483265996" lastFinishedPulling="2026-06-03 00:49:56.912944425 +0000 UTC m=+52.788877771" observedRunningTime="2026-06-03 00:49:57.886690795 +0000 UTC m=+53.762624161" watchObservedRunningTime="2026-06-03 00:49:57.887371858 +0000 UTC m=+53.763305242" Jun 03 00:49:57.900830 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:57.900776 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p2s5p" podStartSLOduration=17.634441097 podStartE2EDuration="19.900759395s" podCreationTimestamp="2026-06-03 00:49:38 +0000 UTC" firstStartedPulling="2026-06-03 00:49:54.651673231 +0000 UTC m=+50.527606578" lastFinishedPulling="2026-06-03 00:49:56.91799153 +0000 UTC m=+52.793924876" observedRunningTime="2026-06-03 00:49:57.900653761 +0000 UTC m=+53.776587127" watchObservedRunningTime="2026-06-03 00:49:57.900759395 +0000 UTC m=+53.776692779" Jun 03 00:49:58.041344 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.041308 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs"] Jun 03 00:49:58.072476 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.072439 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7"] Jun 03 00:49:58.072668 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.072608 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.075192 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.075168 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fmlp5\"" Jun 03 00:49:58.075192 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.075181 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 00:49:58.075382 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.075356 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 00:49:58.075637 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.075620 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 00:49:58.076229 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.076217 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 00:49:58.086413 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.086393 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs"] Jun 03 00:49:58.086413 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.086417 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7"] Jun 03 00:49:58.086608 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.086539 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.089599 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.089575 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 00:49:58.089599 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.089575 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 00:49:58.089763 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.089581 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 00:49:58.090015 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.089994 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 00:49:58.160560 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee6da782-704f-4667-ae3a-dd1f335b0e3a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs\" (UID: \"ee6da782-704f-4667-ae3a-dd1f335b0e3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.160735 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-hub\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.160735 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160617 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.160735 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160634 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.160735 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576qd\" (UniqueName: \"kubernetes.io/projected/ee6da782-704f-4667-ae3a-dd1f335b0e3a-kube-api-access-576qd\") pod \"managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs\" (UID: \"ee6da782-704f-4667-ae3a-dd1f335b0e3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.160890 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5gsf\" (UniqueName: \"kubernetes.io/projected/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-kube-api-access-n5gsf\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.160890 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160763 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-ca\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.160890 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.160778 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.261792 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.261761 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee6da782-704f-4667-ae3a-dd1f335b0e3a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs\" (UID: \"ee6da782-704f-4667-ae3a-dd1f335b0e3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.261792 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.261810 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-hub\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.262011 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.261936 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.262011 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.261984 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.262115 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.262041 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-576qd\" (UniqueName: \"kubernetes.io/projected/ee6da782-704f-4667-ae3a-dd1f335b0e3a-kube-api-access-576qd\") pod \"managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs\" (UID: \"ee6da782-704f-4667-ae3a-dd1f335b0e3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.262115 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.262070 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5gsf\" (UniqueName: \"kubernetes.io/projected/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-kube-api-access-n5gsf\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.262115 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.262097 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-ca\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.262266 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.262119 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.262971 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.262943 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.264665 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.264638 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.264782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.264707 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-hub\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.264782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.264737 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee6da782-704f-4667-ae3a-dd1f335b0e3a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs\" (UID: \"ee6da782-704f-4667-ae3a-dd1f335b0e3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.265194 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.265173 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-ca\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.265316 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.265299 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.272569 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.272542 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5gsf\" (UniqueName: \"kubernetes.io/projected/b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412-kube-api-access-n5gsf\") pod \"cluster-proxy-proxy-agent-57f74c4c74-nxfc7\" (UID: \"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.272862 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.272843 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-576qd\" (UniqueName: \"kubernetes.io/projected/ee6da782-704f-4667-ae3a-dd1f335b0e3a-kube-api-access-576qd\") pod \"managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs\" (UID: \"ee6da782-704f-4667-ae3a-dd1f335b0e3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.390484 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.390447 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" Jun 03 00:49:58.398255 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.398230 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" Jun 03 00:49:58.520933 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.520891 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs"] Jun 03 00:49:58.523548 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:58.523506 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee6da782_704f_4667_ae3a_dd1f335b0e3a.slice/crio-56e7f9146fa9c87da94aa6919fccd7fea3896f5061f596a60b7f4f3a3e3fb0ee WatchSource:0}: Error finding container 56e7f9146fa9c87da94aa6919fccd7fea3896f5061f596a60b7f4f3a3e3fb0ee: Status 404 returned error can't find the container with id 56e7f9146fa9c87da94aa6919fccd7fea3896f5061f596a60b7f4f3a3e3fb0ee Jun 03 00:49:58.538227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.538201 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7"] Jun 03 00:49:58.541023 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:49:58.540999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0a15e6c_e5cf_4b6b_88d8_c6e8c0bbd412.slice/crio-a6da3281725d440f1c1693dacc9c58009267dc0b7a178d32d4cdf1996b7a5d84 WatchSource:0}: Error finding container a6da3281725d440f1c1693dacc9c58009267dc0b7a178d32d4cdf1996b7a5d84: Status 404 returned error can't find the container with id a6da3281725d440f1c1693dacc9c58009267dc0b7a178d32d4cdf1996b7a5d84 Jun 03 00:49:58.865068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.865033 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" event={"ID":"ee6da782-704f-4667-ae3a-dd1f335b0e3a","Type":"ContainerStarted","Data":"56e7f9146fa9c87da94aa6919fccd7fea3896f5061f596a60b7f4f3a3e3fb0ee"} Jun 03 00:49:58.866713 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.866685 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjwc4" event={"ID":"ee7a80ff-428c-4cd5-835b-caa8149a5931","Type":"ContainerStarted","Data":"a9ddc06dce0350512421afdccbf0665fdb646cce454c624a21d98af90af67294"} Jun 03 00:49:58.867620 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.867585 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" event={"ID":"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412","Type":"ContainerStarted","Data":"a6da3281725d440f1c1693dacc9c58009267dc0b7a178d32d4cdf1996b7a5d84"} Jun 03 00:49:58.884061 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:49:58.884019 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jjwc4" podStartSLOduration=17.723058232 podStartE2EDuration="20.884007226s" podCreationTimestamp="2026-06-03 00:49:38 +0000 UTC" firstStartedPulling="2026-06-03 00:49:54.681144103 +0000 UTC m=+50.557077454" lastFinishedPulling="2026-06-03 00:49:57.842093096 +0000 UTC m=+53.718026448" observedRunningTime="2026-06-03 00:49:58.882970847 +0000 UTC m=+54.758904214" watchObservedRunningTime="2026-06-03 00:49:58.884007226 +0000 UTC m=+54.759940589" Jun 03 00:50:03.884603 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:03.884567 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" event={"ID":"ee6da782-704f-4667-ae3a-dd1f335b0e3a","Type":"ContainerStarted","Data":"7bfbdaea208c4b5266adeab38d6a4b7009642b03032f97f1e6b48c1c7c0ae1cc"} Jun 03 00:50:03.885873 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:03.885850 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" event={"ID":"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412","Type":"ContainerStarted","Data":"a303c82558d28638d24e952ca4a179638fb722e7005857e717b7e2f42f636505"} Jun 03 00:50:03.899261 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:03.899213 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f4fc46f6-t8zfs" podStartSLOduration=0.821952333 podStartE2EDuration="5.899199059s" podCreationTimestamp="2026-06-03 00:49:58 +0000 UTC" firstStartedPulling="2026-06-03 00:49:58.525350104 +0000 UTC m=+54.401283448" lastFinishedPulling="2026-06-03 00:50:03.602596814 +0000 UTC m=+59.478530174" observedRunningTime="2026-06-03 00:50:03.898352353 +0000 UTC m=+59.774285741" watchObservedRunningTime="2026-06-03 00:50:03.899199059 +0000 UTC m=+59.775132424" Jun 03 00:50:06.128501 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:06.128467 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjjfg" Jun 03 00:50:07.869950 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:07.869915 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4gqbs" Jun 03 00:50:10.366400 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.366359 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:50:10.369140 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.369116 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:50:10.379891 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.379868 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee87d98c-44ad-43c2-8509-1d4087086c3f-metrics-certs\") pod \"network-metrics-daemon-nrlbr\" (UID: \"ee87d98c-44ad-43c2-8509-1d4087086c3f\") " pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:50:10.466855 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.466817 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:50:10.467028 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.466870 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vkdv\"" Jun 03 00:50:10.469490 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.469466 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:50:10.474632 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.474609 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlbr" Jun 03 00:50:10.479804 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.479781 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:50:10.491198 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.491176 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4qv\" (UniqueName: \"kubernetes.io/projected/95a165fd-418f-4a8e-9a5f-f90601e2de34-kube-api-access-bf4qv\") pod \"network-check-target-hgll5\" (UID: \"95a165fd-418f-4a8e-9a5f-f90601e2de34\") " pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:50:10.639968 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.639887 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nrlbr"] Jun 03 00:50:10.774115 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.773888 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wvk5\"" Jun 03 00:50:10.779880 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.779849 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:50:10.789598 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.789571 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6grxj"] Jun 03 00:50:10.794227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.794201 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.798349 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798148 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7drv6\"" Jun 03 00:50:10.798349 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798197 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 00:50:10.798349 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798158 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 00:50:10.798622 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798562 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 00:50:10.799073 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798754 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 00:50:10.799073 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798828 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 00:50:10.799073 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.798930 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 00:50:10.875084 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875038 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-sys\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875262 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875262 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875262 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-textfile\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875262 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875248 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8mt\" (UniqueName: \"kubernetes.io/projected/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-kube-api-access-zd8mt\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875470 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875272 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-wtmp\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875470 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875331 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-tls\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875470 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-metrics-client-ca\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.875470 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.875388 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-root\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.975966 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.975893 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-root\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.975966 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.975932 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-sys\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.975992 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-sys\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.975995 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-root\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976024 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976059 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976094 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-textfile\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976121 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8mt\" (UniqueName: \"kubernetes.io/projected/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-kube-api-access-zd8mt\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976150 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-wtmp\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.976227 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976217 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-tls\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.977389 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976238 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-metrics-client-ca\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.977389 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.976856 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-metrics-client-ca\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.977389 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.977007 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-wtmp\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.977389 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.977018 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.977389 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.977133 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-textfile\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.980030 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.980005 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-tls\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.982241 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.982202 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:10.984747 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:10.984720 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8mt\" (UniqueName: \"kubernetes.io/projected/b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe-kube-api-access-zd8mt\") pod \"node-exporter-6grxj\" (UID: \"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe\") " pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:11.108922 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.108889 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6grxj" Jun 03 00:50:11.736667 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.736636 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-867c9567cf-7fwns"] Jun 03 00:50:11.739843 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.739807 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.743775 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743750 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 00:50:11.743961 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743927 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 00:50:11.744095 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743972 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 00:50:11.744095 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743755 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 00:50:11.744095 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743887 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 00:50:11.744095 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743887 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 00:50:11.744325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743888 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 00:50:11.744325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.743824 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8c7jt\"" Jun 03 00:50:11.750258 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.750236 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867c9567cf-7fwns"] Jun 03 00:50:11.781072 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.781040 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-oauth-config\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.781219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.781087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-service-ca\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.781219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.781121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-oauth-serving-cert\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.781219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.781149 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnzh\" (UniqueName: \"kubernetes.io/projected/39d62ca7-4028-41db-8958-387d73f1ccd2-kube-api-access-gdnzh\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.781219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.781217 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-serving-cert\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.781404 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.781256 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-console-config\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.881771 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.881732 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-serving-cert\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.881771 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.881792 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-console-config\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.882037 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.881820 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-oauth-config\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.882037 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.881841 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-service-ca\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.882037 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.881872 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-oauth-serving-cert\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.882037 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.881897 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnzh\" (UniqueName: \"kubernetes.io/projected/39d62ca7-4028-41db-8958-387d73f1ccd2-kube-api-access-gdnzh\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.882767 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.882738 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-console-config\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.882899 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.882795 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-oauth-serving-cert\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.883138 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.883076 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-service-ca\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.884635 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.884612 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-oauth-config\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.885317 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.885298 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-serving-cert\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:11.890102 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:11.890073 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnzh\" (UniqueName: \"kubernetes.io/projected/39d62ca7-4028-41db-8958-387d73f1ccd2-kube-api-access-gdnzh\") pod \"console-867c9567cf-7fwns\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:12.006342 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:50:12.006271 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee87d98c_44ad_43c2_8509_1d4087086c3f.slice/crio-3e13a694648b70774ccbea4d46bc231df642f09cfe9c42e064e4e8c6862aba8f WatchSource:0}: Error finding container 3e13a694648b70774ccbea4d46bc231df642f09cfe9c42e064e4e8c6862aba8f: Status 404 returned error can't find the container with id 3e13a694648b70774ccbea4d46bc231df642f09cfe9c42e064e4e8c6862aba8f Jun 03 00:50:12.014579 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:50:12.014547 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b60fc8_4ca9_4d75_b5af_f67b408ce4fe.slice/crio-50fa6e3951f60f06d6825bf8c3c5d964d6ff8a164796b283a9d43fa4cba4603e WatchSource:0}: Error finding container 50fa6e3951f60f06d6825bf8c3c5d964d6ff8a164796b283a9d43fa4cba4603e: Status 404 returned error can't find the container with id 50fa6e3951f60f06d6825bf8c3c5d964d6ff8a164796b283a9d43fa4cba4603e Jun 03 00:50:12.052440 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.052411 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:12.146438 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.146402 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hgll5"] Jun 03 00:50:12.153894 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:50:12.153859 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a165fd_418f_4a8e_9a5f_f90601e2de34.slice/crio-8b5daf2bd6a43f2e9940592265d260fcd263cf44f877be7bd80103b7504f6767 WatchSource:0}: Error finding container 8b5daf2bd6a43f2e9940592265d260fcd263cf44f877be7bd80103b7504f6767: Status 404 returned error can't find the container with id 8b5daf2bd6a43f2e9940592265d260fcd263cf44f877be7bd80103b7504f6767 Jun 03 00:50:12.194461 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.194434 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867c9567cf-7fwns"] Jun 03 00:50:12.197957 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:50:12.197927 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d62ca7_4028_41db_8958_387d73f1ccd2.slice/crio-96f4639f80b507f7ffb5967bce12d3e48b49ede1c3d091442be35ce9d2c92971 WatchSource:0}: Error finding container 96f4639f80b507f7ffb5967bce12d3e48b49ede1c3d091442be35ce9d2c92971: Status 404 returned error can't find the container with id 96f4639f80b507f7ffb5967bce12d3e48b49ede1c3d091442be35ce9d2c92971 Jun 03 00:50:12.913252 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.913214 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6grxj" event={"ID":"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe","Type":"ContainerStarted","Data":"50fa6e3951f60f06d6825bf8c3c5d964d6ff8a164796b283a9d43fa4cba4603e"} Jun 03 00:50:12.915478 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.915421 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" event={"ID":"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412","Type":"ContainerStarted","Data":"8b961c65887edb3b5f3019a3c2c4b4ceabaa31797d2f106b0e0fbdb2de98b67f"} Jun 03 00:50:12.915478 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.915453 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" event={"ID":"b0a15e6c-e5cf-4b6b-88d8-c6e8c0bbd412","Type":"ContainerStarted","Data":"db354165cee32a6b4d38b8b99c8dd0e4b75f9ff3167c610399634526b8943019"} Jun 03 00:50:12.917084 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.917052 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrlbr" event={"ID":"ee87d98c-44ad-43c2-8509-1d4087086c3f","Type":"ContainerStarted","Data":"3e13a694648b70774ccbea4d46bc231df642f09cfe9c42e064e4e8c6862aba8f"} Jun 03 00:50:12.918745 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.918712 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867c9567cf-7fwns" event={"ID":"39d62ca7-4028-41db-8958-387d73f1ccd2","Type":"ContainerStarted","Data":"96f4639f80b507f7ffb5967bce12d3e48b49ede1c3d091442be35ce9d2c92971"} Jun 03 00:50:12.919857 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.919831 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hgll5" event={"ID":"95a165fd-418f-4a8e-9a5f-f90601e2de34","Type":"ContainerStarted","Data":"8b5daf2bd6a43f2e9940592265d260fcd263cf44f877be7bd80103b7504f6767"} Jun 03 00:50:12.934446 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:12.934405 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57f74c4c74-nxfc7" podStartSLOduration=1.4325079729999999 podStartE2EDuration="14.934390965s" podCreationTimestamp="2026-06-03 00:49:58 +0000 UTC" firstStartedPulling="2026-06-03 00:49:58.542762866 +0000 UTC m=+54.418696209" lastFinishedPulling="2026-06-03 00:50:12.044645845 +0000 UTC m=+67.920579201" observedRunningTime="2026-06-03 00:50:12.933899336 +0000 UTC m=+68.809832701" watchObservedRunningTime="2026-06-03 00:50:12.934390965 +0000 UTC m=+68.810324332" Jun 03 00:50:13.717860 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.717823 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78f8879c48-624mw"] Jun 03 00:50:13.720509 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.720487 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.723146 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723120 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 00:50:13.723271 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723236 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 00:50:13.723487 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723468 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 00:50:13.723487 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723480 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qfxp7\"" Jun 03 00:50:13.723743 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723728 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7kit9gq01j4pe\"" Jun 03 00:50:13.724007 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723820 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 00:50:13.724007 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.723943 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 00:50:13.732588 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.732565 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78f8879c48-624mw"] Jun 03 00:50:13.801940 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.801899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.801950 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-metrics-client-ca\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.801977 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tvl\" (UniqueName: \"kubernetes.io/projected/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-kube-api-access-56tvl\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.801998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.802073 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-grpc-tls\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.802138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802185 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.802184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.802499 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.802206 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-tls\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903437 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903403 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903459 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903489 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-tls\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903542 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903571 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-metrics-client-ca\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903589 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56tvl\" (UniqueName: \"kubernetes.io/projected/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-kube-api-access-56tvl\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903613 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.903646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.903644 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-grpc-tls\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.904827 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.904797 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-metrics-client-ca\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.907204 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.907174 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-grpc-tls\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.907988 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.907960 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.908373 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.908329 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.908459 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.908383 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.909118 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.909097 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.909551 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.909494 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-secret-thanos-querier-tls\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.912790 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.912766 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tvl\" (UniqueName: \"kubernetes.io/projected/fc8b9a4c-a52b-438b-9805-b8d26e10dd23-kube-api-access-56tvl\") pod \"thanos-querier-78f8879c48-624mw\" (UID: \"fc8b9a4c-a52b-438b-9805-b8d26e10dd23\") " pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:13.926882 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.926834 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrlbr" event={"ID":"ee87d98c-44ad-43c2-8509-1d4087086c3f","Type":"ContainerStarted","Data":"fcefa10a0410228cb4ab816ea89410f21893f4bd9e1f71eeda86c92123cc59e0"} Jun 03 00:50:13.926882 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.926883 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrlbr" event={"ID":"ee87d98c-44ad-43c2-8509-1d4087086c3f","Type":"ContainerStarted","Data":"41b45201cb3c3c764857557b485462dc8c8426eac41538be9598b312c50fc75f"} Jun 03 00:50:13.929140 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.929113 2570 generic.go:358] "Generic (PLEG): container finished" podID="b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe" containerID="b716e6c2ae45e00fc166151b7fc8af35cc2f4471e0f293b6f3b89600f9bed053" exitCode=0 Jun 03 00:50:13.929277 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.929236 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6grxj" event={"ID":"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe","Type":"ContainerDied","Data":"b716e6c2ae45e00fc166151b7fc8af35cc2f4471e0f293b6f3b89600f9bed053"} Jun 03 00:50:13.966728 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:13.966664 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nrlbr" podStartSLOduration=68.706988873 podStartE2EDuration="1m9.966644048s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:50:12.010494965 +0000 UTC m=+67.886428309" lastFinishedPulling="2026-06-03 00:50:13.270150125 +0000 UTC m=+69.146083484" observedRunningTime="2026-06-03 00:50:13.945643825 +0000 UTC m=+69.821577192" watchObservedRunningTime="2026-06-03 00:50:13.966644048 +0000 UTC m=+69.842577417" Jun 03 00:50:14.032110 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:14.032084 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:14.226495 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:14.226467 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78f8879c48-624mw"] Jun 03 00:50:14.229134 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:50:14.229100 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8b9a4c_a52b_438b_9805_b8d26e10dd23.slice/crio-7413cfba443ac443ed6a4fb64a9759ab67f6f7cb2ff0c95aeb989fda5ecb8361 WatchSource:0}: Error finding container 7413cfba443ac443ed6a4fb64a9759ab67f6f7cb2ff0c95aeb989fda5ecb8361: Status 404 returned error can't find the container with id 7413cfba443ac443ed6a4fb64a9759ab67f6f7cb2ff0c95aeb989fda5ecb8361 Jun 03 00:50:14.934291 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:14.934225 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6grxj" event={"ID":"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe","Type":"ContainerStarted","Data":"a6ff34cd31783995a5c6262d311d61cf60e826577aa8f6dd9f0cd7f5e8dd9ad8"} Jun 03 00:50:14.934291 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:14.934266 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6grxj" event={"ID":"b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe","Type":"ContainerStarted","Data":"87b8d942b669583b046ba4aa963346fbdb0f9fb7cff4ee49a8c1c60e479579bd"} Jun 03 00:50:14.935608 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:14.935576 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"7413cfba443ac443ed6a4fb64a9759ab67f6f7cb2ff0c95aeb989fda5ecb8361"} Jun 03 00:50:14.951201 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:14.951150 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6grxj" podStartSLOduration=4.126498258 podStartE2EDuration="4.951132367s" podCreationTimestamp="2026-06-03 00:50:10 +0000 UTC" firstStartedPulling="2026-06-03 00:50:12.034375725 +0000 UTC m=+67.910309069" lastFinishedPulling="2026-06-03 00:50:12.859009831 +0000 UTC m=+68.734943178" observedRunningTime="2026-06-03 00:50:14.94992826 +0000 UTC m=+70.825861626" watchObservedRunningTime="2026-06-03 00:50:14.951132367 +0000 UTC m=+70.827065738" Jun 03 00:50:16.943808 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:16.943765 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867c9567cf-7fwns" event={"ID":"39d62ca7-4028-41db-8958-387d73f1ccd2","Type":"ContainerStarted","Data":"daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d"} Jun 03 00:50:16.945254 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:16.945227 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hgll5" event={"ID":"95a165fd-418f-4a8e-9a5f-f90601e2de34","Type":"ContainerStarted","Data":"7252d253cbeb23c2d08b0da5ac9591bed4954d6564361b8fbac63ad0d06c3fce"} Jun 03 00:50:16.945381 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:16.945364 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:50:16.961565 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:16.961500 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-867c9567cf-7fwns" podStartSLOduration=1.808043374 podStartE2EDuration="5.961486827s" podCreationTimestamp="2026-06-03 00:50:11 +0000 UTC" firstStartedPulling="2026-06-03 00:50:12.199754986 +0000 UTC m=+68.075688331" lastFinishedPulling="2026-06-03 00:50:16.35319844 +0000 UTC m=+72.229131784" observedRunningTime="2026-06-03 00:50:16.959894141 +0000 UTC m=+72.835827519" watchObservedRunningTime="2026-06-03 00:50:16.961486827 +0000 UTC m=+72.837420192" Jun 03 00:50:16.975101 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:16.975050 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hgll5" podStartSLOduration=68.776990517 podStartE2EDuration="1m12.975036647s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:50:12.156379274 +0000 UTC m=+68.032312621" lastFinishedPulling="2026-06-03 00:50:16.354425407 +0000 UTC m=+72.230358751" observedRunningTime="2026-06-03 00:50:16.97446187 +0000 UTC m=+72.850395230" watchObservedRunningTime="2026-06-03 00:50:16.975036647 +0000 UTC m=+72.850970012" Jun 03 00:50:18.953247 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:18.953163 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"d635213e8b7e65e5482e57d2969234a0b95efc0543159c76c7c0e6a65b8d4b35"} Jun 03 00:50:18.953247 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:18.953198 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"bda20a30785e6dbc127e58cd2d3787e6ac7779f3e1f9220265df035940b733b2"} Jun 03 00:50:18.953247 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:18.953208 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"739e9854fb51df22d46a7e69c62376503988f279beec829649e0dd5362aecb3b"} Jun 03 00:50:19.958736 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:19.958707 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"16c062598ce3b42eb03468e0d70a199541d7ebe8cffe52f57029155a6520bacf"} Jun 03 00:50:19.959059 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:19.958743 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"4624d9ac505f7edf624bcdebc324e9fb8888e43e52f6a3332523a90240d6a47f"} Jun 03 00:50:20.964027 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:20.963988 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" event={"ID":"fc8b9a4c-a52b-438b-9805-b8d26e10dd23","Type":"ContainerStarted","Data":"c4dfc1d11943a61b1274ac82f4ed628e3c5b354346ed4f8bb42d53b70ed7875b"} Jun 03 00:50:20.964549 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:20.964219 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:20.986184 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:20.986136 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" podStartSLOduration=2.442292059 podStartE2EDuration="7.986122327s" podCreationTimestamp="2026-06-03 00:50:13 +0000 UTC" firstStartedPulling="2026-06-03 00:50:14.231964055 +0000 UTC m=+70.107897405" lastFinishedPulling="2026-06-03 00:50:19.775794328 +0000 UTC m=+75.651727673" observedRunningTime="2026-06-03 00:50:20.983917067 +0000 UTC m=+76.859850434" watchObservedRunningTime="2026-06-03 00:50:20.986122327 +0000 UTC m=+76.862055693" Jun 03 00:50:22.052563 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:22.052506 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:22.053007 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:22.052576 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:22.057243 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:22.057218 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:22.974034 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:22.974005 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:26.974371 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:26.974341 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78f8879c48-624mw" Jun 03 00:50:32.726984 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:32.726950 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867c9567cf-7fwns"] Jun 03 00:50:47.950406 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:47.950366 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hgll5" Jun 03 00:50:57.747083 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:57.747026 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-867c9567cf-7fwns" podUID="39d62ca7-4028-41db-8958-387d73f1ccd2" containerName="console" containerID="cri-o://daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d" gracePeriod=15 Jun 03 00:50:57.981690 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:57.981668 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-867c9567cf-7fwns_39d62ca7-4028-41db-8958-387d73f1ccd2/console/0.log" Jun 03 00:50:57.981842 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:57.981738 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:58.059796 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.059709 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-867c9567cf-7fwns_39d62ca7-4028-41db-8958-387d73f1ccd2/console/0.log" Jun 03 00:50:58.059796 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.059755 2570 generic.go:358] "Generic (PLEG): container finished" podID="39d62ca7-4028-41db-8958-387d73f1ccd2" containerID="daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d" exitCode=2 Jun 03 00:50:58.059974 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.059817 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867c9567cf-7fwns" Jun 03 00:50:58.059974 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.059847 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867c9567cf-7fwns" event={"ID":"39d62ca7-4028-41db-8958-387d73f1ccd2","Type":"ContainerDied","Data":"daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d"} Jun 03 00:50:58.059974 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.059885 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867c9567cf-7fwns" event={"ID":"39d62ca7-4028-41db-8958-387d73f1ccd2","Type":"ContainerDied","Data":"96f4639f80b507f7ffb5967bce12d3e48b49ede1c3d091442be35ce9d2c92971"} Jun 03 00:50:58.059974 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.059903 2570 scope.go:117] "RemoveContainer" containerID="daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d" Jun 03 00:50:58.068823 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.068807 2570 scope.go:117] "RemoveContainer" containerID="daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d" Jun 03 00:50:58.069071 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:50:58.069043 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d\": container with ID starting with daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d not found: ID does not exist" containerID="daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d" Jun 03 00:50:58.069149 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.069079 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d"} err="failed to get container status \"daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d\": rpc error: code = NotFound desc = could not find container \"daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d\": container with ID starting with daecfbd768840740a5be98a9ce2f954786e41d17943671dcfc15da90cc06046d not found: ID does not exist" Jun 03 00:50:58.130406 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130369 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-service-ca\") pod \"39d62ca7-4028-41db-8958-387d73f1ccd2\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " Jun 03 00:50:58.130406 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130408 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdnzh\" (UniqueName: \"kubernetes.io/projected/39d62ca7-4028-41db-8958-387d73f1ccd2-kube-api-access-gdnzh\") pod \"39d62ca7-4028-41db-8958-387d73f1ccd2\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " Jun 03 00:50:58.130655 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130426 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-console-config\") pod \"39d62ca7-4028-41db-8958-387d73f1ccd2\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " Jun 03 00:50:58.130655 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130474 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-serving-cert\") pod \"39d62ca7-4028-41db-8958-387d73f1ccd2\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " Jun 03 00:50:58.130655 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130505 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-oauth-serving-cert\") pod \"39d62ca7-4028-41db-8958-387d73f1ccd2\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " Jun 03 00:50:58.130655 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130599 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-oauth-config\") pod \"39d62ca7-4028-41db-8958-387d73f1ccd2\" (UID: \"39d62ca7-4028-41db-8958-387d73f1ccd2\") " Jun 03 00:50:58.130919 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130885 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-console-config" (OuterVolumeSpecName: "console-config") pod "39d62ca7-4028-41db-8958-387d73f1ccd2" (UID: "39d62ca7-4028-41db-8958-387d73f1ccd2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:50:58.130919 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130898 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-service-ca" (OuterVolumeSpecName: "service-ca") pod "39d62ca7-4028-41db-8958-387d73f1ccd2" (UID: "39d62ca7-4028-41db-8958-387d73f1ccd2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:50:58.130919 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.130917 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39d62ca7-4028-41db-8958-387d73f1ccd2" (UID: "39d62ca7-4028-41db-8958-387d73f1ccd2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:50:58.132895 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.132866 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d62ca7-4028-41db-8958-387d73f1ccd2-kube-api-access-gdnzh" (OuterVolumeSpecName: "kube-api-access-gdnzh") pod "39d62ca7-4028-41db-8958-387d73f1ccd2" (UID: "39d62ca7-4028-41db-8958-387d73f1ccd2"). InnerVolumeSpecName "kube-api-access-gdnzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:50:58.132985 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.132918 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39d62ca7-4028-41db-8958-387d73f1ccd2" (UID: "39d62ca7-4028-41db-8958-387d73f1ccd2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:50:58.132985 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.132947 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39d62ca7-4028-41db-8958-387d73f1ccd2" (UID: "39d62ca7-4028-41db-8958-387d73f1ccd2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:50:58.231954 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.231923 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-oauth-config\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:50:58.231954 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.231951 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-service-ca\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:50:58.232144 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.231978 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdnzh\" (UniqueName: \"kubernetes.io/projected/39d62ca7-4028-41db-8958-387d73f1ccd2-kube-api-access-gdnzh\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:50:58.232144 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.231988 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-console-config\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:50:58.232144 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.231997 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d62ca7-4028-41db-8958-387d73f1ccd2-console-serving-cert\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:50:58.232144 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.232006 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d62ca7-4028-41db-8958-387d73f1ccd2-oauth-serving-cert\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:50:58.380054 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.380021 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867c9567cf-7fwns"] Jun 03 00:50:58.383552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.383509 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-867c9567cf-7fwns"] Jun 03 00:50:58.656473 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:50:58.656392 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d62ca7-4028-41db-8958-387d73f1ccd2" path="/var/lib/kubelet/pods/39d62ca7-4028-41db-8958-387d73f1ccd2/volumes" Jun 03 00:53:24.924175 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.924139 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ckwcv"] Jun 03 00:53:24.924660 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.924379 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d62ca7-4028-41db-8958-387d73f1ccd2" containerName="console" Jun 03 00:53:24.924660 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.924391 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d62ca7-4028-41db-8958-387d73f1ccd2" containerName="console" Jun 03 00:53:24.924660 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.924430 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="39d62ca7-4028-41db-8958-387d73f1ccd2" containerName="console" Jun 03 00:53:24.926057 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.926041 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:24.928593 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.928574 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 00:53:24.934106 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.934085 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ckwcv"] Jun 03 00:53:24.946791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.946761 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11c60fe2-574b-4658-b34a-ff2696516757-original-pull-secret\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:24.947064 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.947035 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11c60fe2-574b-4658-b34a-ff2696516757-kubelet-config\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:24.947184 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:24.947089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11c60fe2-574b-4658-b34a-ff2696516757-dbus\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.048306 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.048267 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11c60fe2-574b-4658-b34a-ff2696516757-dbus\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.048539 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.048353 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11c60fe2-574b-4658-b34a-ff2696516757-original-pull-secret\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.048539 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.048395 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11c60fe2-574b-4658-b34a-ff2696516757-kubelet-config\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.048539 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.048448 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11c60fe2-574b-4658-b34a-ff2696516757-dbus\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.048539 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.048471 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11c60fe2-574b-4658-b34a-ff2696516757-kubelet-config\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.050737 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.050714 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11c60fe2-574b-4658-b34a-ff2696516757-original-pull-secret\") pod \"global-pull-secret-syncer-ckwcv\" (UID: \"11c60fe2-574b-4658-b34a-ff2696516757\") " pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.234893 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.234803 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckwcv" Jun 03 00:53:25.357296 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.357264 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ckwcv"] Jun 03 00:53:25.360234 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:53:25.360206 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c60fe2_574b_4658_b34a_ff2696516757.slice/crio-9fba6f4d49f698aa1346c963811c82f651d2f4ddff38037d8cc440771ed62b4f WatchSource:0}: Error finding container 9fba6f4d49f698aa1346c963811c82f651d2f4ddff38037d8cc440771ed62b4f: Status 404 returned error can't find the container with id 9fba6f4d49f698aa1346c963811c82f651d2f4ddff38037d8cc440771ed62b4f Jun 03 00:53:25.428265 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:25.428232 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ckwcv" event={"ID":"11c60fe2-574b-4658-b34a-ff2696516757","Type":"ContainerStarted","Data":"9fba6f4d49f698aa1346c963811c82f651d2f4ddff38037d8cc440771ed62b4f"} Jun 03 00:53:30.443812 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:30.443772 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ckwcv" event={"ID":"11c60fe2-574b-4658-b34a-ff2696516757","Type":"ContainerStarted","Data":"44093f452d6a3a6786675b867f859d7de51e7679b0cab61175c8b6653ec3944a"} Jun 03 00:53:30.457819 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:53:30.457767 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ckwcv" podStartSLOduration=2.438657871 podStartE2EDuration="6.457753786s" podCreationTimestamp="2026-06-03 00:53:24 +0000 UTC" firstStartedPulling="2026-06-03 00:53:25.361809465 +0000 UTC m=+261.237742808" lastFinishedPulling="2026-06-03 00:53:29.380905373 +0000 UTC m=+265.256838723" observedRunningTime="2026-06-03 00:53:30.457158309 +0000 UTC m=+266.333091678" watchObservedRunningTime="2026-06-03 00:53:30.457753786 +0000 UTC m=+266.333687152" Jun 03 00:54:04.558675 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:04.558644 2570 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 00:54:05.881614 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.881583 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm"] Jun 03 00:54:05.883612 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.883596 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:05.886727 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.886706 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:54:05.887363 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.887335 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lf86j\"" Jun 03 00:54:05.888339 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.888322 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 00:54:05.903850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.903813 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm"] Jun 03 00:54:05.939122 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.939084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/321e62b5-7de1-475f-8150-a7b0fa024651-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-m4tkm\" (UID: \"321e62b5-7de1-475f-8150-a7b0fa024651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:05.939122 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:05.939121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcdh\" (UniqueName: \"kubernetes.io/projected/321e62b5-7de1-475f-8150-a7b0fa024651-kube-api-access-kzcdh\") pod \"cert-manager-operator-controller-manager-54b9655956-m4tkm\" (UID: \"321e62b5-7de1-475f-8150-a7b0fa024651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:06.040269 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.040230 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/321e62b5-7de1-475f-8150-a7b0fa024651-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-m4tkm\" (UID: \"321e62b5-7de1-475f-8150-a7b0fa024651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:06.040417 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.040272 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcdh\" (UniqueName: \"kubernetes.io/projected/321e62b5-7de1-475f-8150-a7b0fa024651-kube-api-access-kzcdh\") pod \"cert-manager-operator-controller-manager-54b9655956-m4tkm\" (UID: \"321e62b5-7de1-475f-8150-a7b0fa024651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:06.040736 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.040712 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/321e62b5-7de1-475f-8150-a7b0fa024651-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-m4tkm\" (UID: \"321e62b5-7de1-475f-8150-a7b0fa024651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:06.048480 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.048457 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcdh\" (UniqueName: \"kubernetes.io/projected/321e62b5-7de1-475f-8150-a7b0fa024651-kube-api-access-kzcdh\") pod \"cert-manager-operator-controller-manager-54b9655956-m4tkm\" (UID: \"321e62b5-7de1-475f-8150-a7b0fa024651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:06.193042 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.192948 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" Jun 03 00:54:06.325069 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.325038 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm"] Jun 03 00:54:06.329190 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:54:06.329156 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321e62b5_7de1_475f_8150_a7b0fa024651.slice/crio-2a1e4e9238104b9d70586d0c47a2fb88df13044391bc9521acf9adba8960b5f6 WatchSource:0}: Error finding container 2a1e4e9238104b9d70586d0c47a2fb88df13044391bc9521acf9adba8960b5f6: Status 404 returned error can't find the container with id 2a1e4e9238104b9d70586d0c47a2fb88df13044391bc9521acf9adba8960b5f6 Jun 03 00:54:06.331916 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.331899 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:54:06.536973 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:06.536883 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" event={"ID":"321e62b5-7de1-475f-8150-a7b0fa024651","Type":"ContainerStarted","Data":"2a1e4e9238104b9d70586d0c47a2fb88df13044391bc9521acf9adba8960b5f6"} Jun 03 00:54:09.546560 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:09.546490 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" event={"ID":"321e62b5-7de1-475f-8150-a7b0fa024651","Type":"ContainerStarted","Data":"92db076e39edb4fbe6e02e6d243bd6951b2e476085652f9b20566546e288c520"} Jun 03 00:54:09.569622 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:09.569564 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-m4tkm" podStartSLOduration=2.318033817 podStartE2EDuration="4.569548451s" podCreationTimestamp="2026-06-03 00:54:05 +0000 UTC" firstStartedPulling="2026-06-03 00:54:06.332057762 +0000 UTC m=+302.207991106" lastFinishedPulling="2026-06-03 00:54:08.583572382 +0000 UTC m=+304.459505740" observedRunningTime="2026-06-03 00:54:09.567462562 +0000 UTC m=+305.443395940" watchObservedRunningTime="2026-06-03 00:54:09.569548451 +0000 UTC m=+305.445481816" Jun 03 00:54:14.819899 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.819863 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kgwzx"] Jun 03 00:54:14.821731 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.821714 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:14.824706 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.824685 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 00:54:14.824802 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.824685 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 00:54:14.825658 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.825640 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9npzh\"" Jun 03 00:54:14.837539 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.834906 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kgwzx"] Jun 03 00:54:14.910493 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.910457 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvd75\" (UniqueName: \"kubernetes.io/projected/b7b2eb76-3d37-45de-b984-66f77d2bdcf3-kube-api-access-jvd75\") pod \"cert-manager-cainjector-68b757865b-kgwzx\" (UID: \"b7b2eb76-3d37-45de-b984-66f77d2bdcf3\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:14.910683 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:14.910534 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7b2eb76-3d37-45de-b984-66f77d2bdcf3-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kgwzx\" (UID: \"b7b2eb76-3d37-45de-b984-66f77d2bdcf3\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:15.010830 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.010793 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvd75\" (UniqueName: \"kubernetes.io/projected/b7b2eb76-3d37-45de-b984-66f77d2bdcf3-kube-api-access-jvd75\") pod \"cert-manager-cainjector-68b757865b-kgwzx\" (UID: \"b7b2eb76-3d37-45de-b984-66f77d2bdcf3\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:15.011013 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.010851 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7b2eb76-3d37-45de-b984-66f77d2bdcf3-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kgwzx\" (UID: \"b7b2eb76-3d37-45de-b984-66f77d2bdcf3\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:15.018675 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.018642 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7b2eb76-3d37-45de-b984-66f77d2bdcf3-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kgwzx\" (UID: \"b7b2eb76-3d37-45de-b984-66f77d2bdcf3\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:15.018815 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.018689 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvd75\" (UniqueName: \"kubernetes.io/projected/b7b2eb76-3d37-45de-b984-66f77d2bdcf3-kube-api-access-jvd75\") pod \"cert-manager-cainjector-68b757865b-kgwzx\" (UID: \"b7b2eb76-3d37-45de-b984-66f77d2bdcf3\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:15.130460 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.130425 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" Jun 03 00:54:15.255621 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.255586 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kgwzx"] Jun 03 00:54:15.258996 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:54:15.258948 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7b2eb76_3d37_45de_b984_66f77d2bdcf3.slice/crio-dbee274c676d8de96c78fc7a6d4e01292b34c553c75a84f031ea71cb131bb945 WatchSource:0}: Error finding container dbee274c676d8de96c78fc7a6d4e01292b34c553c75a84f031ea71cb131bb945: Status 404 returned error can't find the container with id dbee274c676d8de96c78fc7a6d4e01292b34c553c75a84f031ea71cb131bb945 Jun 03 00:54:15.562816 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:15.562731 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" event={"ID":"b7b2eb76-3d37-45de-b984-66f77d2bdcf3","Type":"ContainerStarted","Data":"dbee274c676d8de96c78fc7a6d4e01292b34c553c75a84f031ea71cb131bb945"} Jun 03 00:54:18.572071 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:18.572038 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" event={"ID":"b7b2eb76-3d37-45de-b984-66f77d2bdcf3","Type":"ContainerStarted","Data":"472c7332b2bc10bc4f8ea06088f10b9608430da11166850810d761c0ee80617e"} Jun 03 00:54:18.587396 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:18.587348 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kgwzx" podStartSLOduration=1.961835612 podStartE2EDuration="4.587333195s" podCreationTimestamp="2026-06-03 00:54:14 +0000 UTC" firstStartedPulling="2026-06-03 00:54:15.261380928 +0000 UTC m=+311.137314272" lastFinishedPulling="2026-06-03 00:54:17.886878511 +0000 UTC m=+313.762811855" observedRunningTime="2026-06-03 00:54:18.585906907 +0000 UTC m=+314.461840273" watchObservedRunningTime="2026-06-03 00:54:18.587333195 +0000 UTC m=+314.463266560" Jun 03 00:54:43.428245 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.428209 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7"] Jun 03 00:54:43.432935 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.432913 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.437673 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.437651 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 00:54:43.437804 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.437722 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 00:54:43.437804 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.437757 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-frtgw\"" Jun 03 00:54:43.437804 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.437765 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:54:43.437804 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.437764 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 00:54:43.438004 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.437811 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 00:54:43.449908 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.449883 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7"] Jun 03 00:54:43.529246 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.529207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/243afe83-a497-4a13-b233-2a7d67753572-cert\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.529420 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.529253 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/243afe83-a497-4a13-b233-2a7d67753572-manager-config\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.529420 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.529284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt722\" (UniqueName: \"kubernetes.io/projected/243afe83-a497-4a13-b233-2a7d67753572-kube-api-access-zt722\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.529420 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.529337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/243afe83-a497-4a13-b233-2a7d67753572-metrics-cert\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.629717 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.629684 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/243afe83-a497-4a13-b233-2a7d67753572-metrics-cert\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.629717 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.629720 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/243afe83-a497-4a13-b233-2a7d67753572-cert\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.629930 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.629769 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/243afe83-a497-4a13-b233-2a7d67753572-manager-config\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.629930 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.629814 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zt722\" (UniqueName: \"kubernetes.io/projected/243afe83-a497-4a13-b233-2a7d67753572-kube-api-access-zt722\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.630427 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.630402 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/243afe83-a497-4a13-b233-2a7d67753572-manager-config\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.632474 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.632443 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/243afe83-a497-4a13-b233-2a7d67753572-cert\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.632589 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.632443 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/243afe83-a497-4a13-b233-2a7d67753572-metrics-cert\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.642953 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.642928 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt722\" (UniqueName: \"kubernetes.io/projected/243afe83-a497-4a13-b233-2a7d67753572-kube-api-access-zt722\") pod \"lws-controller-manager-8474b9f56-bmhh7\" (UID: \"243afe83-a497-4a13-b233-2a7d67753572\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.742412 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.742316 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:43.866711 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:43.866675 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7"] Jun 03 00:54:43.869568 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:54:43.869541 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243afe83_a497_4a13_b233_2a7d67753572.slice/crio-840a91b0239f37c5b53fc67c543a9f016399fc8fd184659286ceecf120a9e334 WatchSource:0}: Error finding container 840a91b0239f37c5b53fc67c543a9f016399fc8fd184659286ceecf120a9e334: Status 404 returned error can't find the container with id 840a91b0239f37c5b53fc67c543a9f016399fc8fd184659286ceecf120a9e334 Jun 03 00:54:44.643563 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:44.643502 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" event={"ID":"243afe83-a497-4a13-b233-2a7d67753572","Type":"ContainerStarted","Data":"840a91b0239f37c5b53fc67c543a9f016399fc8fd184659286ceecf120a9e334"} Jun 03 00:54:46.502575 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.502456 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r"] Jun 03 00:54:46.506068 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.506044 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.508782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.508658 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 00:54:46.508782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.508674 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 00:54:46.508782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.508667 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 00:54:46.508782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.508743 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 00:54:46.509205 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.509192 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-whgm8\"" Jun 03 00:54:46.518936 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.518908 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r"] Jun 03 00:54:46.552798 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.552764 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.552960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.552801 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzpb7\" (UniqueName: \"kubernetes.io/projected/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-kube-api-access-tzpb7\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.552960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.552840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.552960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.552881 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.552960 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.552904 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.653231 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.653200 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.653410 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.653259 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.653410 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.653290 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.653410 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.653342 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.653410 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.653370 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzpb7\" (UniqueName: \"kubernetes.io/projected/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-kube-api-access-tzpb7\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.653755 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.653719 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.655511 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.655480 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" event={"ID":"243afe83-a497-4a13-b233-2a7d67753572","Type":"ContainerStarted","Data":"ef58ddbc5057defca9bead1232ef914c0296ea7f9c8cd9a59d3945233e040d7c"} Jun 03 00:54:46.655643 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.655546 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:54:46.655946 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.655924 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.655987 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.655962 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.656020 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.656009 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.665121 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.665097 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzpb7\" (UniqueName: \"kubernetes.io/projected/a1b76afc-e647-4cd8-99e7-59c2cf5d5c10-kube-api-access-tzpb7\") pod \"opendatahub-operator-controller-manager-7c859dd94f-f4k4r\" (UID: \"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.671732 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.671679 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" podStartSLOduration=1.378051638 podStartE2EDuration="3.671665357s" podCreationTimestamp="2026-06-03 00:54:43 +0000 UTC" firstStartedPulling="2026-06-03 00:54:43.871308182 +0000 UTC m=+339.747241527" lastFinishedPulling="2026-06-03 00:54:46.164921885 +0000 UTC m=+342.040855246" observedRunningTime="2026-06-03 00:54:46.670261543 +0000 UTC m=+342.546194908" watchObservedRunningTime="2026-06-03 00:54:46.671665357 +0000 UTC m=+342.547598725" Jun 03 00:54:46.816297 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.816213 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:46.946774 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:46.946739 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r"] Jun 03 00:54:46.949932 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:54:46.949905 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b76afc_e647_4cd8_99e7_59c2cf5d5c10.slice/crio-0003b8fc0712c178897d88367531397ccda2aeed2201d87891296a5b9e7be5b1 WatchSource:0}: Error finding container 0003b8fc0712c178897d88367531397ccda2aeed2201d87891296a5b9e7be5b1: Status 404 returned error can't find the container with id 0003b8fc0712c178897d88367531397ccda2aeed2201d87891296a5b9e7be5b1 Jun 03 00:54:47.659229 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:47.659186 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" event={"ID":"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10","Type":"ContainerStarted","Data":"0003b8fc0712c178897d88367531397ccda2aeed2201d87891296a5b9e7be5b1"} Jun 03 00:54:50.671045 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:50.671011 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" event={"ID":"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10","Type":"ContainerStarted","Data":"d6759e63c6314092e7635cf0f94324c8602c05bf9c97c41d29a2c7ef57ca8e19"} Jun 03 00:54:51.675312 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:51.675279 2570 generic.go:358] "Generic (PLEG): container finished" podID="a1b76afc-e647-4cd8-99e7-59c2cf5d5c10" containerID="d6759e63c6314092e7635cf0f94324c8602c05bf9c97c41d29a2c7ef57ca8e19" exitCode=0 Jun 03 00:54:51.675768 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:51.675364 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" event={"ID":"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10","Type":"ContainerDied","Data":"d6759e63c6314092e7635cf0f94324c8602c05bf9c97c41d29a2c7ef57ca8e19"} Jun 03 00:54:52.680235 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:52.680194 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" event={"ID":"a1b76afc-e647-4cd8-99e7-59c2cf5d5c10","Type":"ContainerStarted","Data":"e380f6b08529cff1abb7361cb6d3c7b3fb9258a02dc49d4b5af84fe2f16ada2e"} Jun 03 00:54:52.680660 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:52.680321 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:54:52.701366 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:52.701319 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" podStartSLOduration=1.633788247 podStartE2EDuration="6.701304712s" podCreationTimestamp="2026-06-03 00:54:46 +0000 UTC" firstStartedPulling="2026-06-03 00:54:46.951604867 +0000 UTC m=+342.827538211" lastFinishedPulling="2026-06-03 00:54:52.01912133 +0000 UTC m=+347.895054676" observedRunningTime="2026-06-03 00:54:52.699089956 +0000 UTC m=+348.575023322" watchObservedRunningTime="2026-06-03 00:54:52.701304712 +0000 UTC m=+348.577238079" Jun 03 00:54:57.661366 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:54:57.661336 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-bmhh7" Jun 03 00:55:03.685215 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:03.685182 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-f4k4r" Jun 03 00:55:53.501331 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.501294 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf"] Jun 03 00:55:53.503763 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.503738 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.506731 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.506682 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 00:55:53.506962 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.506943 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dltlx\"" Jun 03 00:55:53.507195 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.507179 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 00:55:53.507396 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.507374 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 00:55:53.515774 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.515749 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf"] Jun 03 00:55:53.668145 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668145 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr6nl\" (UniqueName: \"kubernetes.io/projected/6b0646a4-fe57-47c2-8b38-215492a455ef-kube-api-access-pr6nl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668360 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b0646a4-fe57-47c2-8b38-215492a455ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668360 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668360 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668360 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668301 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668484 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668394 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668484 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.668484 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.668468 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769259 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769159 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769259 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769207 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769259 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769246 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769557 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769281 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769557 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769309 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pr6nl\" (UniqueName: \"kubernetes.io/projected/6b0646a4-fe57-47c2-8b38-215492a455ef-kube-api-access-pr6nl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769557 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769347 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b0646a4-fe57-47c2-8b38-215492a455ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769715 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769684 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769770 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769729 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769770 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769743 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769879 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769794 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769879 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769797 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.769990 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.769918 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.770104 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.770079 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b0646a4-fe57-47c2-8b38-215492a455ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.770374 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.770287 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.771933 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.771913 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.772202 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.772184 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.776913 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.776888 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr6nl\" (UniqueName: \"kubernetes.io/projected/6b0646a4-fe57-47c2-8b38-215492a455ef-kube-api-access-pr6nl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.777001 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.776975 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b0646a4-fe57-47c2-8b38-215492a455ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf\" (UID: \"6b0646a4-fe57-47c2-8b38-215492a455ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.815656 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.815619 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:53.942477 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:53.942448 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf"] Jun 03 00:55:53.944864 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:55:53.944834 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0646a4_fe57_47c2_8b38_215492a455ef.slice/crio-c7db6690339303485c8e7b4bb78608c27dd8c30436e993e88a3cd027625bdaae WatchSource:0}: Error finding container c7db6690339303485c8e7b4bb78608c27dd8c30436e993e88a3cd027625bdaae: Status 404 returned error can't find the container with id c7db6690339303485c8e7b4bb78608c27dd8c30436e993e88a3cd027625bdaae Jun 03 00:55:54.024294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.024209 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6995685bb-df85f"] Jun 03 00:55:54.026906 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.026886 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.029453 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.029427 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vm7g2\"" Jun 03 00:55:54.029594 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.029456 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 00:55:54.036412 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.036384 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6995685bb-df85f"] Jun 03 00:55:54.173846 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.173810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/964001d6-b2f7-43a3-867f-d04682fb1f3e-redirect-config\") pod \"dashboard-redirect-6995685bb-df85f\" (UID: \"964001d6-b2f7-43a3-867f-d04682fb1f3e\") " pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.174034 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.173866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2kdt\" (UniqueName: \"kubernetes.io/projected/964001d6-b2f7-43a3-867f-d04682fb1f3e-kube-api-access-b2kdt\") pod \"dashboard-redirect-6995685bb-df85f\" (UID: \"964001d6-b2f7-43a3-867f-d04682fb1f3e\") " pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.274858 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.274766 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/964001d6-b2f7-43a3-867f-d04682fb1f3e-redirect-config\") pod \"dashboard-redirect-6995685bb-df85f\" (UID: \"964001d6-b2f7-43a3-867f-d04682fb1f3e\") " pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.274858 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.274828 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2kdt\" (UniqueName: \"kubernetes.io/projected/964001d6-b2f7-43a3-867f-d04682fb1f3e-kube-api-access-b2kdt\") pod \"dashboard-redirect-6995685bb-df85f\" (UID: \"964001d6-b2f7-43a3-867f-d04682fb1f3e\") " pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.275502 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.275482 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/964001d6-b2f7-43a3-867f-d04682fb1f3e-redirect-config\") pod \"dashboard-redirect-6995685bb-df85f\" (UID: \"964001d6-b2f7-43a3-867f-d04682fb1f3e\") " pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.282736 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.282710 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2kdt\" (UniqueName: \"kubernetes.io/projected/964001d6-b2f7-43a3-867f-d04682fb1f3e-kube-api-access-b2kdt\") pod \"dashboard-redirect-6995685bb-df85f\" (UID: \"964001d6-b2f7-43a3-867f-d04682fb1f3e\") " pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.337673 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.337645 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6995685bb-df85f" Jun 03 00:55:54.479669 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.479638 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6995685bb-df85f"] Jun 03 00:55:54.482769 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:55:54.482737 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964001d6_b2f7_43a3_867f_d04682fb1f3e.slice/crio-586799defc0e82ec842614964e5aa7b944e9a715676524dd7ac6bd3684a40b51 WatchSource:0}: Error finding container 586799defc0e82ec842614964e5aa7b944e9a715676524dd7ac6bd3684a40b51: Status 404 returned error can't find the container with id 586799defc0e82ec842614964e5aa7b944e9a715676524dd7ac6bd3684a40b51 Jun 03 00:55:54.863539 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.863473 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6995685bb-df85f" event={"ID":"964001d6-b2f7-43a3-867f-d04682fb1f3e","Type":"ContainerStarted","Data":"586799defc0e82ec842614964e5aa7b944e9a715676524dd7ac6bd3684a40b51"} Jun 03 00:55:54.864549 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:54.864500 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" event={"ID":"6b0646a4-fe57-47c2-8b38-215492a455ef","Type":"ContainerStarted","Data":"c7db6690339303485c8e7b4bb78608c27dd8c30436e993e88a3cd027625bdaae"} Jun 03 00:55:57.754136 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.754102 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 00:55:57.754485 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.754200 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 00:55:57.754485 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.754249 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 00:55:57.876899 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.876860 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6995685bb-df85f" event={"ID":"964001d6-b2f7-43a3-867f-d04682fb1f3e","Type":"ContainerStarted","Data":"505035afeaf0665762248c7452248191e26e90f07c72eccce26efcd4a8e5f620"} Jun 03 00:55:57.878328 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.878306 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" event={"ID":"6b0646a4-fe57-47c2-8b38-215492a455ef","Type":"ContainerStarted","Data":"60f2d92b2a072842e2a308fdf1171d836890848f98848be9f1878aea35c11025"} Jun 03 00:55:57.893612 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.893556 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6995685bb-df85f" podStartSLOduration=0.652016168 podStartE2EDuration="3.893539532s" podCreationTimestamp="2026-06-03 00:55:54 +0000 UTC" firstStartedPulling="2026-06-03 00:55:54.48408412 +0000 UTC m=+410.360017464" lastFinishedPulling="2026-06-03 00:55:57.725607484 +0000 UTC m=+413.601540828" observedRunningTime="2026-06-03 00:55:57.891274166 +0000 UTC m=+413.767207531" watchObservedRunningTime="2026-06-03 00:55:57.893539532 +0000 UTC m=+413.769472895" Jun 03 00:55:57.909222 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:57.909154 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" podStartSLOduration=1.101928588 podStartE2EDuration="4.909135253s" podCreationTimestamp="2026-06-03 00:55:53 +0000 UTC" firstStartedPulling="2026-06-03 00:55:53.946688653 +0000 UTC m=+409.822622011" lastFinishedPulling="2026-06-03 00:55:57.753895329 +0000 UTC m=+413.629828676" observedRunningTime="2026-06-03 00:55:57.908373569 +0000 UTC m=+413.784306936" watchObservedRunningTime="2026-06-03 00:55:57.909135253 +0000 UTC m=+413.785068621" Jun 03 00:55:58.816052 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:58.816008 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:58.820631 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:58.820605 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:58.881673 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:58.881637 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:55:58.882325 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:55:58.882307 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf" Jun 03 00:56:06.837399 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.837362 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qpkxk"] Jun 03 00:56:06.840319 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.840294 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:06.844330 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.844302 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 00:56:06.844445 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.844386 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cjvxs\"" Jun 03 00:56:06.844445 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.844302 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 00:56:06.848117 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.848091 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qpkxk"] Jun 03 00:56:06.878656 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.878622 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnj49\" (UniqueName: \"kubernetes.io/projected/743e8619-fcea-4b34-a7e3-40ca5e24fa8e-kube-api-access-pnj49\") pod \"kuadrant-operator-catalog-qpkxk\" (UID: \"743e8619-fcea-4b34-a7e3-40ca5e24fa8e\") " pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:06.979244 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.979208 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnj49\" (UniqueName: \"kubernetes.io/projected/743e8619-fcea-4b34-a7e3-40ca5e24fa8e-kube-api-access-pnj49\") pod \"kuadrant-operator-catalog-qpkxk\" (UID: \"743e8619-fcea-4b34-a7e3-40ca5e24fa8e\") " pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:06.989259 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:06.989225 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnj49\" (UniqueName: \"kubernetes.io/projected/743e8619-fcea-4b34-a7e3-40ca5e24fa8e-kube-api-access-pnj49\") pod \"kuadrant-operator-catalog-qpkxk\" (UID: \"743e8619-fcea-4b34-a7e3-40ca5e24fa8e\") " pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:07.151141 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.151104 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:07.275904 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.275882 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qpkxk"] Jun 03 00:56:07.278434 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:56:07.278403 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743e8619_fcea_4b34_a7e3_40ca5e24fa8e.slice/crio-2294f85eba0413876230b00aac7fdcf138570d5aed4a54af2f6bfea9ee902b06 WatchSource:0}: Error finding container 2294f85eba0413876230b00aac7fdcf138570d5aed4a54af2f6bfea9ee902b06: Status 404 returned error can't find the container with id 2294f85eba0413876230b00aac7fdcf138570d5aed4a54af2f6bfea9ee902b06 Jun 03 00:56:07.428256 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.428175 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qpkxk"] Jun 03 00:56:07.444062 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.444031 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vk4wm"] Jun 03 00:56:07.446693 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.446677 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:07.455942 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.455910 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vk4wm"] Jun 03 00:56:07.484492 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.484449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9czp\" (UniqueName: \"kubernetes.io/projected/f0b15f3b-e466-46db-8526-5733c9097800-kube-api-access-m9czp\") pod \"kuadrant-operator-catalog-vk4wm\" (UID: \"f0b15f3b-e466-46db-8526-5733c9097800\") " pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:07.585359 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.585325 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9czp\" (UniqueName: \"kubernetes.io/projected/f0b15f3b-e466-46db-8526-5733c9097800-kube-api-access-m9czp\") pod \"kuadrant-operator-catalog-vk4wm\" (UID: \"f0b15f3b-e466-46db-8526-5733c9097800\") " pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:07.594060 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.594039 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9czp\" (UniqueName: \"kubernetes.io/projected/f0b15f3b-e466-46db-8526-5733c9097800-kube-api-access-m9czp\") pod \"kuadrant-operator-catalog-vk4wm\" (UID: \"f0b15f3b-e466-46db-8526-5733c9097800\") " pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:07.756601 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.756493 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:07.880240 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.880212 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vk4wm"] Jun 03 00:56:07.882533 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:56:07.882489 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b15f3b_e466_46db_8526_5733c9097800.slice/crio-94ca3e872d2caec7e8d1c13452fd6323861ccadbc14e72771f182b87a218730c WatchSource:0}: Error finding container 94ca3e872d2caec7e8d1c13452fd6323861ccadbc14e72771f182b87a218730c: Status 404 returned error can't find the container with id 94ca3e872d2caec7e8d1c13452fd6323861ccadbc14e72771f182b87a218730c Jun 03 00:56:07.908868 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.908837 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" event={"ID":"f0b15f3b-e466-46db-8526-5733c9097800","Type":"ContainerStarted","Data":"94ca3e872d2caec7e8d1c13452fd6323861ccadbc14e72771f182b87a218730c"} Jun 03 00:56:07.909841 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:07.909817 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" event={"ID":"743e8619-fcea-4b34-a7e3-40ca5e24fa8e","Type":"ContainerStarted","Data":"2294f85eba0413876230b00aac7fdcf138570d5aed4a54af2f6bfea9ee902b06"} Jun 03 00:56:09.919030 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:09.918990 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" event={"ID":"f0b15f3b-e466-46db-8526-5733c9097800","Type":"ContainerStarted","Data":"7f7e31c9e8f9bb60e7b7576effeb5293a32be929ea8b79516929e0c69cf3c5cf"} Jun 03 00:56:09.920295 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:09.920271 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" event={"ID":"743e8619-fcea-4b34-a7e3-40ca5e24fa8e","Type":"ContainerStarted","Data":"4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628"} Jun 03 00:56:09.920408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:09.920344 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" podUID="743e8619-fcea-4b34-a7e3-40ca5e24fa8e" containerName="registry-server" containerID="cri-o://4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628" gracePeriod=2 Jun 03 00:56:09.934270 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:09.934227 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" podStartSLOduration=1.301711798 podStartE2EDuration="2.934213545s" podCreationTimestamp="2026-06-03 00:56:07 +0000 UTC" firstStartedPulling="2026-06-03 00:56:07.883951359 +0000 UTC m=+423.759884703" lastFinishedPulling="2026-06-03 00:56:09.516453105 +0000 UTC m=+425.392386450" observedRunningTime="2026-06-03 00:56:09.933540642 +0000 UTC m=+425.809474009" watchObservedRunningTime="2026-06-03 00:56:09.934213545 +0000 UTC m=+425.810146912" Jun 03 00:56:09.947295 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:09.947249 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" podStartSLOduration=1.7143471639999999 podStartE2EDuration="3.947237561s" podCreationTimestamp="2026-06-03 00:56:06 +0000 UTC" firstStartedPulling="2026-06-03 00:56:07.280215134 +0000 UTC m=+423.156148478" lastFinishedPulling="2026-06-03 00:56:09.513105526 +0000 UTC m=+425.389038875" observedRunningTime="2026-06-03 00:56:09.946612145 +0000 UTC m=+425.822545503" watchObservedRunningTime="2026-06-03 00:56:09.947237561 +0000 UTC m=+425.823170942" Jun 03 00:56:10.154240 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.154214 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:10.206546 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.206440 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnj49\" (UniqueName: \"kubernetes.io/projected/743e8619-fcea-4b34-a7e3-40ca5e24fa8e-kube-api-access-pnj49\") pod \"743e8619-fcea-4b34-a7e3-40ca5e24fa8e\" (UID: \"743e8619-fcea-4b34-a7e3-40ca5e24fa8e\") " Jun 03 00:56:10.208711 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.208689 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/743e8619-fcea-4b34-a7e3-40ca5e24fa8e-kube-api-access-pnj49" (OuterVolumeSpecName: "kube-api-access-pnj49") pod "743e8619-fcea-4b34-a7e3-40ca5e24fa8e" (UID: "743e8619-fcea-4b34-a7e3-40ca5e24fa8e"). InnerVolumeSpecName "kube-api-access-pnj49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:56:10.307282 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.307229 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnj49\" (UniqueName: \"kubernetes.io/projected/743e8619-fcea-4b34-a7e3-40ca5e24fa8e-kube-api-access-pnj49\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:56:10.929087 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.929048 2570 generic.go:358] "Generic (PLEG): container finished" podID="743e8619-fcea-4b34-a7e3-40ca5e24fa8e" containerID="4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628" exitCode=0 Jun 03 00:56:10.929561 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.929127 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" Jun 03 00:56:10.929561 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.929132 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" event={"ID":"743e8619-fcea-4b34-a7e3-40ca5e24fa8e","Type":"ContainerDied","Data":"4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628"} Jun 03 00:56:10.929561 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.929173 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qpkxk" event={"ID":"743e8619-fcea-4b34-a7e3-40ca5e24fa8e","Type":"ContainerDied","Data":"2294f85eba0413876230b00aac7fdcf138570d5aed4a54af2f6bfea9ee902b06"} Jun 03 00:56:10.929561 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.929195 2570 scope.go:117] "RemoveContainer" containerID="4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628" Jun 03 00:56:10.938121 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.938099 2570 scope.go:117] "RemoveContainer" containerID="4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628" Jun 03 00:56:10.938356 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:56:10.938339 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628\": container with ID starting with 4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628 not found: ID does not exist" containerID="4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628" Jun 03 00:56:10.938413 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.938362 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628"} err="failed to get container status \"4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628\": rpc error: code = NotFound desc = could not find container \"4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628\": container with ID starting with 4169ee5ccde5c5d7cd652ed79916b08fd47d64ecd7fa9bcbb7ffc6b6faab2628 not found: ID does not exist" Jun 03 00:56:10.944044 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.944019 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qpkxk"] Jun 03 00:56:10.947790 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:10.947770 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qpkxk"] Jun 03 00:56:12.656497 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:12.656460 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="743e8619-fcea-4b34-a7e3-40ca5e24fa8e" path="/var/lib/kubelet/pods/743e8619-fcea-4b34-a7e3-40ca5e24fa8e/volumes" Jun 03 00:56:17.756976 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:17.756929 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:17.757414 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:17.757078 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:17.779509 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:17.779486 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:17.972094 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:17.972066 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vk4wm" Jun 03 00:56:40.387724 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.387682 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql"] Jun 03 00:56:40.388347 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.388088 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743e8619-fcea-4b34-a7e3-40ca5e24fa8e" containerName="registry-server" Jun 03 00:56:40.388347 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.388106 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="743e8619-fcea-4b34-a7e3-40ca5e24fa8e" containerName="registry-server" Jun 03 00:56:40.388347 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.388196 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="743e8619-fcea-4b34-a7e3-40ca5e24fa8e" containerName="registry-server" Jun 03 00:56:40.397913 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.397884 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.401109 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.401084 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-knd2h\"" Jun 03 00:56:40.401543 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.401489 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql"] Jun 03 00:56:40.559407 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.559366 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps972\" (UniqueName: \"kubernetes.io/projected/e723ca09-c4da-43dc-838c-01788813560e-kube-api-access-ps972\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.559407 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.559408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e723ca09-c4da-43dc-838c-01788813560e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.660883 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.660783 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps972\" (UniqueName: \"kubernetes.io/projected/e723ca09-c4da-43dc-838c-01788813560e-kube-api-access-ps972\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.660883 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.660832 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e723ca09-c4da-43dc-838c-01788813560e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.661190 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.661172 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e723ca09-c4da-43dc-838c-01788813560e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.670828 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.670806 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps972\" (UniqueName: \"kubernetes.io/projected/e723ca09-c4da-43dc-838c-01788813560e-kube-api-access-ps972\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.708474 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.708448 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:40.840296 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:40.840262 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql"] Jun 03 00:56:40.845794 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:56:40.843629 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode723ca09_c4da_43dc_838c_01788813560e.slice/crio-f51eb858ad4e73271d5f76438f8184b617c561eb32cfe351ba9635bd49360ad3 WatchSource:0}: Error finding container f51eb858ad4e73271d5f76438f8184b617c561eb32cfe351ba9635bd49360ad3: Status 404 returned error can't find the container with id f51eb858ad4e73271d5f76438f8184b617c561eb32cfe351ba9635bd49360ad3 Jun 03 00:56:41.021648 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:41.021563 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" event={"ID":"e723ca09-c4da-43dc-838c-01788813560e","Type":"ContainerStarted","Data":"f51eb858ad4e73271d5f76438f8184b617c561eb32cfe351ba9635bd49360ad3"} Jun 03 00:56:44.834853 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.834817 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5675b64db6-96htw"] Jun 03 00:56:44.837366 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.837339 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.840089 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.840066 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 00:56:44.840434 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.840416 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 00:56:44.840632 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.840611 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 00:56:44.840713 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.840650 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 00:56:44.840953 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.840933 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 00:56:44.841494 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.841475 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8c7jt\"" Jun 03 00:56:44.841494 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.841486 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 00:56:44.841704 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.841553 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 00:56:44.848045 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.848021 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 00:56:44.858112 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.858085 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5675b64db6-96htw"] Jun 03 00:56:44.999213 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999167 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-service-ca\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.999404 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b809f305-582a-4374-aa68-e43f29415a57-console-serving-cert\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.999404 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-console-config\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.999404 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-trusted-ca-bundle\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.999404 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b809f305-582a-4374-aa68-e43f29415a57-console-oauth-config\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.999605 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-oauth-serving-cert\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:44.999605 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:44.999449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbh7w\" (UniqueName: \"kubernetes.io/projected/b809f305-582a-4374-aa68-e43f29415a57-kube-api-access-sbh7w\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.100830 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.100733 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-oauth-serving-cert\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.100830 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.100782 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbh7w\" (UniqueName: \"kubernetes.io/projected/b809f305-582a-4374-aa68-e43f29415a57-kube-api-access-sbh7w\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101066 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.100922 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-service-ca\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101066 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.100998 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b809f305-582a-4374-aa68-e43f29415a57-console-serving-cert\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101066 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.101030 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-console-config\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101224 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.101069 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-trusted-ca-bundle\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101224 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.101129 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b809f305-582a-4374-aa68-e43f29415a57-console-oauth-config\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101752 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.101616 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-oauth-serving-cert\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101868 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.101812 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-service-ca\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.101979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.101917 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-console-config\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.102112 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.102091 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b809f305-582a-4374-aa68-e43f29415a57-trusted-ca-bundle\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.104160 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.104140 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b809f305-582a-4374-aa68-e43f29415a57-console-oauth-config\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.104366 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.104350 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b809f305-582a-4374-aa68-e43f29415a57-console-serving-cert\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.117386 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.117362 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbh7w\" (UniqueName: \"kubernetes.io/projected/b809f305-582a-4374-aa68-e43f29415a57-kube-api-access-sbh7w\") pod \"console-5675b64db6-96htw\" (UID: \"b809f305-582a-4374-aa68-e43f29415a57\") " pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:45.150238 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:45.150204 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:46.039128 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:46.039090 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" event={"ID":"e723ca09-c4da-43dc-838c-01788813560e","Type":"ContainerStarted","Data":"715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2"} Jun 03 00:56:46.039567 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:46.039225 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:46.049140 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:46.049095 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5675b64db6-96htw"] Jun 03 00:56:46.051944 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:56:46.051918 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb809f305_582a_4374_aa68_e43f29415a57.slice/crio-2f03019ed58ab626908331bbd3c7a4bdb616f652461e96740b7015548d6282e3 WatchSource:0}: Error finding container 2f03019ed58ab626908331bbd3c7a4bdb616f652461e96740b7015548d6282e3: Status 404 returned error can't find the container with id 2f03019ed58ab626908331bbd3c7a4bdb616f652461e96740b7015548d6282e3 Jun 03 00:56:46.064093 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:46.064054 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" podStartSLOduration=0.964926092 podStartE2EDuration="6.064038541s" podCreationTimestamp="2026-06-03 00:56:40 +0000 UTC" firstStartedPulling="2026-06-03 00:56:40.847116056 +0000 UTC m=+456.723049400" lastFinishedPulling="2026-06-03 00:56:45.946228505 +0000 UTC m=+461.822161849" observedRunningTime="2026-06-03 00:56:46.063542075 +0000 UTC m=+461.939475436" watchObservedRunningTime="2026-06-03 00:56:46.064038541 +0000 UTC m=+461.939971909" Jun 03 00:56:47.044336 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:47.044301 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5675b64db6-96htw" event={"ID":"b809f305-582a-4374-aa68-e43f29415a57","Type":"ContainerStarted","Data":"8d2cf29c85cba2e18e833ca412138cf77b4340a74af24a2a8fa2621816ef166f"} Jun 03 00:56:47.044336 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:47.044345 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5675b64db6-96htw" event={"ID":"b809f305-582a-4374-aa68-e43f29415a57","Type":"ContainerStarted","Data":"2f03019ed58ab626908331bbd3c7a4bdb616f652461e96740b7015548d6282e3"} Jun 03 00:56:47.064964 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:47.064897 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5675b64db6-96htw" podStartSLOduration=3.064879743 podStartE2EDuration="3.064879743s" podCreationTimestamp="2026-06-03 00:56:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:56:47.063038482 +0000 UTC m=+462.938971849" watchObservedRunningTime="2026-06-03 00:56:47.064879743 +0000 UTC m=+462.940813109" Jun 03 00:56:48.803075 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.803041 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28"] Jun 03 00:56:48.805324 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.805300 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:48.808260 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.808237 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 00:56:48.808377 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.808334 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 00:56:48.808377 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.808355 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2d4wz\"" Jun 03 00:56:48.816582 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.816562 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28"] Jun 03 00:56:48.936038 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.935998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:48.936219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.936078 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wzm6\" (UniqueName: \"kubernetes.io/projected/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-kube-api-access-4wzm6\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:48.936219 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:48.936108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.037322 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.037281 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wzm6\" (UniqueName: \"kubernetes.io/projected/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-kube-api-access-4wzm6\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.037322 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.037338 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.037631 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.037418 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.038269 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.038244 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.040919 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.040891 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.049617 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.049582 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wzm6\" (UniqueName: \"kubernetes.io/projected/c10a49ce-d30a-4e4b-ad1b-bd91999ab57a-kube-api-access-4wzm6\") pod \"kuadrant-console-plugin-6cb54b5c86-rjl28\" (UID: \"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.115646 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.115617 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" Jun 03 00:56:49.248279 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:49.248236 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28"] Jun 03 00:56:49.251964 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:56:49.251936 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc10a49ce_d30a_4e4b_ad1b_bd91999ab57a.slice/crio-c866aa5d4479788c9e71ce6b6b7a7080a04bdf14034251c2c9998ab6cf7c2546 WatchSource:0}: Error finding container c866aa5d4479788c9e71ce6b6b7a7080a04bdf14034251c2c9998ab6cf7c2546: Status 404 returned error can't find the container with id c866aa5d4479788c9e71ce6b6b7a7080a04bdf14034251c2c9998ab6cf7c2546 Jun 03 00:56:50.058908 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:50.058848 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" event={"ID":"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a","Type":"ContainerStarted","Data":"c866aa5d4479788c9e71ce6b6b7a7080a04bdf14034251c2c9998ab6cf7c2546"} Jun 03 00:56:55.150705 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:55.150610 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:55.150705 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:55.150657 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:55.157424 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:55.157391 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:56.085528 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:56.085498 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5675b64db6-96htw" Jun 03 00:56:57.047108 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:57.047064 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:58.735193 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.735162 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql"] Jun 03 00:56:58.735663 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.735397 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" podUID="e723ca09-c4da-43dc-838c-01788813560e" containerName="manager" containerID="cri-o://715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2" gracePeriod=2 Jun 03 00:56:58.740633 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.740602 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql"] Jun 03 00:56:58.754125 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.754091 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw"] Jun 03 00:56:58.754638 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.754614 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e723ca09-c4da-43dc-838c-01788813560e" containerName="manager" Jun 03 00:56:58.754638 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.754637 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e723ca09-c4da-43dc-838c-01788813560e" containerName="manager" Jun 03 00:56:58.754822 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.754735 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="e723ca09-c4da-43dc-838c-01788813560e" containerName="manager" Jun 03 00:56:58.760450 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.760430 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.762753 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.762716 2570 status_manager.go:895] "Failed to get status for pod" podUID="e723ca09-c4da-43dc-838c-01788813560e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" is forbidden: User \"system:node:ip-10-0-140-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-130.ec2.internal' and this object" Jun 03 00:56:58.767970 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.767917 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw"] Jun 03 00:56:58.816052 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.816023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9x88\" (UniqueName: \"kubernetes.io/projected/42ca6815-305d-4069-a641-f2e0612fa9bb-kube-api-access-c9x88\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-s4nzw\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.816192 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.816068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ca6815-305d-4069-a641-f2e0612fa9bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-s4nzw\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.917189 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.917160 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9x88\" (UniqueName: \"kubernetes.io/projected/42ca6815-305d-4069-a641-f2e0612fa9bb-kube-api-access-c9x88\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-s4nzw\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.917338 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.917198 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ca6815-305d-4069-a641-f2e0612fa9bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-s4nzw\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.917611 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.917594 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ca6815-305d-4069-a641-f2e0612fa9bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-s4nzw\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.926944 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.926920 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9x88\" (UniqueName: \"kubernetes.io/projected/42ca6815-305d-4069-a641-f2e0612fa9bb-kube-api-access-c9x88\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-s4nzw\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:58.968486 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.968466 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:58.970722 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:58.970698 2570 status_manager.go:895] "Failed to get status for pod" podUID="e723ca09-c4da-43dc-838c-01788813560e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" is forbidden: User \"system:node:ip-10-0-140-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-130.ec2.internal' and this object" Jun 03 00:56:59.018450 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.018362 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e723ca09-c4da-43dc-838c-01788813560e-extensions-socket-volume\") pod \"e723ca09-c4da-43dc-838c-01788813560e\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " Jun 03 00:56:59.018450 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.018422 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps972\" (UniqueName: \"kubernetes.io/projected/e723ca09-c4da-43dc-838c-01788813560e-kube-api-access-ps972\") pod \"e723ca09-c4da-43dc-838c-01788813560e\" (UID: \"e723ca09-c4da-43dc-838c-01788813560e\") " Jun 03 00:56:59.018961 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.018930 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e723ca09-c4da-43dc-838c-01788813560e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e723ca09-c4da-43dc-838c-01788813560e" (UID: "e723ca09-c4da-43dc-838c-01788813560e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:56:59.020947 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.020918 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e723ca09-c4da-43dc-838c-01788813560e-kube-api-access-ps972" (OuterVolumeSpecName: "kube-api-access-ps972") pod "e723ca09-c4da-43dc-838c-01788813560e" (UID: "e723ca09-c4da-43dc-838c-01788813560e"). InnerVolumeSpecName "kube-api-access-ps972". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:56:59.093380 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.093343 2570 generic.go:358] "Generic (PLEG): container finished" podID="e723ca09-c4da-43dc-838c-01788813560e" containerID="715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2" exitCode=0 Jun 03 00:56:59.093623 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.093397 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" Jun 03 00:56:59.093623 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.093423 2570 scope.go:117] "RemoveContainer" containerID="715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2" Jun 03 00:56:59.095789 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.095761 2570 status_manager.go:895] "Failed to get status for pod" podUID="e723ca09-c4da-43dc-838c-01788813560e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" is forbidden: User \"system:node:ip-10-0-140-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-130.ec2.internal' and this object" Jun 03 00:56:59.101729 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.101709 2570 scope.go:117] "RemoveContainer" containerID="715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2" Jun 03 00:56:59.101986 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:56:59.101966 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2\": container with ID starting with 715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2 not found: ID does not exist" containerID="715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2" Jun 03 00:56:59.102040 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.101995 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2"} err="failed to get container status \"715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2\": rpc error: code = NotFound desc = could not find container \"715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2\": container with ID starting with 715ba4ba003b02764007449e860904705afe256548848540cbd857c5106549a2 not found: ID does not exist" Jun 03 00:56:59.103840 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.103821 2570 status_manager.go:895] "Failed to get status for pod" podUID="e723ca09-c4da-43dc-838c-01788813560e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b4xql" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b4xql\" is forbidden: User \"system:node:ip-10-0-140-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-130.ec2.internal' and this object" Jun 03 00:56:59.113084 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.113060 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:56:59.120011 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.119985 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e723ca09-c4da-43dc-838c-01788813560e-extensions-socket-volume\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:56:59.120071 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.120018 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps972\" (UniqueName: \"kubernetes.io/projected/e723ca09-c4da-43dc-838c-01788813560e-kube-api-access-ps972\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:56:59.279421 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:56:59.279385 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw"] Jun 03 00:57:00.657295 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:00.657263 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e723ca09-c4da-43dc-838c-01788813560e" path="/var/lib/kubelet/pods/e723ca09-c4da-43dc-838c-01788813560e/volumes" Jun 03 00:57:13.341097 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:57:13.341054 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ca6815_305d_4069_a641_f2e0612fa9bb.slice/crio-bead887950d0f5801c1f9debd7d3ff3eaf599c345af13a3358ea92dcc3ee204f WatchSource:0}: Error finding container bead887950d0f5801c1f9debd7d3ff3eaf599c345af13a3358ea92dcc3ee204f: Status 404 returned error can't find the container with id bead887950d0f5801c1f9debd7d3ff3eaf599c345af13a3358ea92dcc3ee204f Jun 03 00:57:14.147328 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:14.147286 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" event={"ID":"c10a49ce-d30a-4e4b-ad1b-bd91999ab57a","Type":"ContainerStarted","Data":"3857604bc3153a586153963563df8620b8819668480c275111157ef5fac7598b"} Jun 03 00:57:14.148638 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:14.148605 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" event={"ID":"42ca6815-305d-4069-a641-f2e0612fa9bb","Type":"ContainerStarted","Data":"b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4"} Jun 03 00:57:14.148638 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:14.148643 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" event={"ID":"42ca6815-305d-4069-a641-f2e0612fa9bb","Type":"ContainerStarted","Data":"bead887950d0f5801c1f9debd7d3ff3eaf599c345af13a3358ea92dcc3ee204f"} Jun 03 00:57:14.148955 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:14.148717 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:57:14.167930 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:14.167863 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rjl28" podStartSLOduration=1.99490158 podStartE2EDuration="26.167845783s" podCreationTimestamp="2026-06-03 00:56:48 +0000 UTC" firstStartedPulling="2026-06-03 00:56:49.253502748 +0000 UTC m=+465.129436092" lastFinishedPulling="2026-06-03 00:57:13.42644695 +0000 UTC m=+489.302380295" observedRunningTime="2026-06-03 00:57:14.165448947 +0000 UTC m=+490.041382328" watchObservedRunningTime="2026-06-03 00:57:14.167845783 +0000 UTC m=+490.043779149" Jun 03 00:57:14.185321 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:14.185266 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" podStartSLOduration=16.185251531 podStartE2EDuration="16.185251531s" podCreationTimestamp="2026-06-03 00:56:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:57:14.184639691 +0000 UTC m=+490.060573055" watchObservedRunningTime="2026-06-03 00:57:14.185251531 +0000 UTC m=+490.061184902" Jun 03 00:57:17.071475 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.071435 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw"] Jun 03 00:57:17.071922 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.071686 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" podUID="42ca6815-305d-4069-a641-f2e0612fa9bb" containerName="manager" containerID="cri-o://b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4" gracePeriod=10 Jun 03 00:57:17.320330 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.320307 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:57:17.366408 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.366383 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9x88\" (UniqueName: \"kubernetes.io/projected/42ca6815-305d-4069-a641-f2e0612fa9bb-kube-api-access-c9x88\") pod \"42ca6815-305d-4069-a641-f2e0612fa9bb\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " Jun 03 00:57:17.366576 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.366429 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ca6815-305d-4069-a641-f2e0612fa9bb-extensions-socket-volume\") pod \"42ca6815-305d-4069-a641-f2e0612fa9bb\" (UID: \"42ca6815-305d-4069-a641-f2e0612fa9bb\") " Jun 03 00:57:17.366845 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.366822 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42ca6815-305d-4069-a641-f2e0612fa9bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42ca6815-305d-4069-a641-f2e0612fa9bb" (UID: "42ca6815-305d-4069-a641-f2e0612fa9bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:57:17.368655 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.368632 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ca6815-305d-4069-a641-f2e0612fa9bb-kube-api-access-c9x88" (OuterVolumeSpecName: "kube-api-access-c9x88") pod "42ca6815-305d-4069-a641-f2e0612fa9bb" (UID: "42ca6815-305d-4069-a641-f2e0612fa9bb"). InnerVolumeSpecName "kube-api-access-c9x88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:57:17.467855 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.467817 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9x88\" (UniqueName: \"kubernetes.io/projected/42ca6815-305d-4069-a641-f2e0612fa9bb-kube-api-access-c9x88\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:57:17.467855 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:17.467846 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ca6815-305d-4069-a641-f2e0612fa9bb-extensions-socket-volume\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:57:18.162694 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.162660 2570 generic.go:358] "Generic (PLEG): container finished" podID="42ca6815-305d-4069-a641-f2e0612fa9bb" containerID="b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4" exitCode=0 Jun 03 00:57:18.163090 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.162723 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" Jun 03 00:57:18.163090 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.162728 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" event={"ID":"42ca6815-305d-4069-a641-f2e0612fa9bb","Type":"ContainerDied","Data":"b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4"} Jun 03 00:57:18.163090 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.162831 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw" event={"ID":"42ca6815-305d-4069-a641-f2e0612fa9bb","Type":"ContainerDied","Data":"bead887950d0f5801c1f9debd7d3ff3eaf599c345af13a3358ea92dcc3ee204f"} Jun 03 00:57:18.163090 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.162852 2570 scope.go:117] "RemoveContainer" containerID="b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4" Jun 03 00:57:18.171699 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.171679 2570 scope.go:117] "RemoveContainer" containerID="b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4" Jun 03 00:57:18.171969 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:57:18.171950 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4\": container with ID starting with b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4 not found: ID does not exist" containerID="b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4" Jun 03 00:57:18.172018 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.171979 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4"} err="failed to get container status \"b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4\": rpc error: code = NotFound desc = could not find container \"b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4\": container with ID starting with b9a0a4fd7a817caf09bb96b42ee17b55e75965306881184f2ceb28a7cc7f05f4 not found: ID does not exist" Jun 03 00:57:18.186211 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.186183 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw"] Jun 03 00:57:18.191617 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.191592 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-s4nzw"] Jun 03 00:57:18.656034 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:18.655996 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ca6815-305d-4069-a641-f2e0612fa9bb" path="/var/lib/kubelet/pods/42ca6815-305d-4069-a641-f2e0612fa9bb/volumes" Jun 03 00:57:33.318890 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.318852 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm"] Jun 03 00:57:33.319466 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.319170 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ca6815-305d-4069-a641-f2e0612fa9bb" containerName="manager" Jun 03 00:57:33.319466 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.319188 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ca6815-305d-4069-a641-f2e0612fa9bb" containerName="manager" Jun 03 00:57:33.319466 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.319286 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="42ca6815-305d-4069-a641-f2e0612fa9bb" containerName="manager" Jun 03 00:57:33.325082 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.325061 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.328449 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.328430 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wgrxd\"" Jun 03 00:57:33.334676 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.334652 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm"] Jun 03 00:57:33.400106 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400303 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400303 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400303 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77whn\" (UniqueName: \"kubernetes.io/projected/1f92e533-6e98-4b5d-bfc3-5973c027411c-kube-api-access-77whn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400303 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400214 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400303 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400254 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400303 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400580 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.400580 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.400335 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f92e533-6e98-4b5d-bfc3-5973c027411c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501324 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501284 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f92e533-6e98-4b5d-bfc3-5973c027411c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501340 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501373 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501416 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501443 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77whn\" (UniqueName: \"kubernetes.io/projected/1f92e533-6e98-4b5d-bfc3-5973c027411c-kube-api-access-77whn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501480 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501552 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501551 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501868 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501589 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501868 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501628 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.501868 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501823 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.502018 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501886 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.502018 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.501947 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.502018 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.502001 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.502163 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.502091 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f92e533-6e98-4b5d-bfc3-5973c027411c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.504009 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.503989 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.504335 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.504315 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.508999 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.508968 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f92e533-6e98-4b5d-bfc3-5973c027411c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.509363 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.509347 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77whn\" (UniqueName: \"kubernetes.io/projected/1f92e533-6e98-4b5d-bfc3-5973c027411c-kube-api-access-77whn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-zkdnm\" (UID: \"1f92e533-6e98-4b5d-bfc3-5973c027411c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.636294 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.636258 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:33.763600 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.763570 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm"] Jun 03 00:57:33.767057 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:57:33.767022 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f92e533_6e98_4b5d_bfc3_5973c027411c.slice/crio-c6d4fa60d5d769df52140224af45f024d78a1df88bc91791327af45a332be0f2 WatchSource:0}: Error finding container c6d4fa60d5d769df52140224af45f024d78a1df88bc91791327af45a332be0f2: Status 404 returned error can't find the container with id c6d4fa60d5d769df52140224af45f024d78a1df88bc91791327af45a332be0f2 Jun 03 00:57:33.769231 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.769198 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 00:57:33.769349 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.769268 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 00:57:33.769349 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:33.769296 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 00:57:34.217563 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:34.217505 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" event={"ID":"1f92e533-6e98-4b5d-bfc3-5973c027411c","Type":"ContainerStarted","Data":"08afe10faa9d1494331c40367f00f4a63c53591b3388213a71040a67678595ed"} Jun 03 00:57:34.217563 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:34.217559 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" event={"ID":"1f92e533-6e98-4b5d-bfc3-5973c027411c","Type":"ContainerStarted","Data":"c6d4fa60d5d769df52140224af45f024d78a1df88bc91791327af45a332be0f2"} Jun 03 00:57:34.239257 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:34.239195 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" podStartSLOduration=1.239176982 podStartE2EDuration="1.239176982s" podCreationTimestamp="2026-06-03 00:57:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:57:34.237068031 +0000 UTC m=+510.113001398" watchObservedRunningTime="2026-06-03 00:57:34.239176982 +0000 UTC m=+510.115110349" Jun 03 00:57:34.636636 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:34.636598 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:34.641465 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:34.641438 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:35.221498 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.221466 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:35.222387 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.222367 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-zkdnm" Jun 03 00:57:35.249853 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.249817 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:35.252029 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.251998 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.254412 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.254393 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 00:57:35.260089 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.260067 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:35.319571 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.319540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2651481-d632-4bb4-a9db-c292bddc8d28-config-file\") pod \"limitador-limitador-7d549b5b-m4zpp\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.319758 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.319710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfc5z\" (UniqueName: \"kubernetes.io/projected/b2651481-d632-4bb4-a9db-c292bddc8d28-kube-api-access-hfc5z\") pod \"limitador-limitador-7d549b5b-m4zpp\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.359769 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.359734 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:35.421210 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.421178 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2651481-d632-4bb4-a9db-c292bddc8d28-config-file\") pod \"limitador-limitador-7d549b5b-m4zpp\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.421379 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.421275 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfc5z\" (UniqueName: \"kubernetes.io/projected/b2651481-d632-4bb4-a9db-c292bddc8d28-kube-api-access-hfc5z\") pod \"limitador-limitador-7d549b5b-m4zpp\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.421921 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.421901 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2651481-d632-4bb4-a9db-c292bddc8d28-config-file\") pod \"limitador-limitador-7d549b5b-m4zpp\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.434557 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.434534 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfc5z\" (UniqueName: \"kubernetes.io/projected/b2651481-d632-4bb4-a9db-c292bddc8d28-kube-api-access-hfc5z\") pod \"limitador-limitador-7d549b5b-m4zpp\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.566793 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.566702 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:35.699079 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:35.699054 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:35.701626 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:57:35.701595 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2651481_d632_4bb4_a9db_c292bddc8d28.slice/crio-aca06d752b8da11694f4453c48109996c8dd29fc13e55c6bb93efea93ffc1202 WatchSource:0}: Error finding container aca06d752b8da11694f4453c48109996c8dd29fc13e55c6bb93efea93ffc1202: Status 404 returned error can't find the container with id aca06d752b8da11694f4453c48109996c8dd29fc13e55c6bb93efea93ffc1202 Jun 03 00:57:36.090337 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.090301 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sln6b"] Jun 03 00:57:36.093146 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.093129 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:36.095674 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.095660 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mqwtd\"" Jun 03 00:57:36.099804 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.099775 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sln6b"] Jun 03 00:57:36.225710 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.225673 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" event={"ID":"b2651481-d632-4bb4-a9db-c292bddc8d28","Type":"ContainerStarted","Data":"aca06d752b8da11694f4453c48109996c8dd29fc13e55c6bb93efea93ffc1202"} Jun 03 00:57:36.228301 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.228283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwl7t\" (UniqueName: \"kubernetes.io/projected/203fb17b-dcfd-4b53-98f0-b642c361ca13-kube-api-access-jwl7t\") pod \"authorino-f99f4b5cd-sln6b\" (UID: \"203fb17b-dcfd-4b53-98f0-b642c361ca13\") " pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:36.295086 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.295054 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-ft2zw"] Jun 03 00:57:36.297119 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.297104 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:57:36.306000 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.305978 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ft2zw"] Jun 03 00:57:36.329678 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.329653 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwl7t\" (UniqueName: \"kubernetes.io/projected/203fb17b-dcfd-4b53-98f0-b642c361ca13-kube-api-access-jwl7t\") pod \"authorino-f99f4b5cd-sln6b\" (UID: \"203fb17b-dcfd-4b53-98f0-b642c361ca13\") " pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:36.337451 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.337426 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwl7t\" (UniqueName: \"kubernetes.io/projected/203fb17b-dcfd-4b53-98f0-b642c361ca13-kube-api-access-jwl7t\") pod \"authorino-f99f4b5cd-sln6b\" (UID: \"203fb17b-dcfd-4b53-98f0-b642c361ca13\") " pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:36.402911 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.402883 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:36.430983 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.430946 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltqk\" (UniqueName: \"kubernetes.io/projected/418f255a-6db7-4429-8e4e-a91dc259092c-kube-api-access-8ltqk\") pod \"authorino-7498df8756-ft2zw\" (UID: \"418f255a-6db7-4429-8e4e-a91dc259092c\") " pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:57:36.532450 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.532307 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltqk\" (UniqueName: \"kubernetes.io/projected/418f255a-6db7-4429-8e4e-a91dc259092c-kube-api-access-8ltqk\") pod \"authorino-7498df8756-ft2zw\" (UID: \"418f255a-6db7-4429-8e4e-a91dc259092c\") " pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:57:36.541259 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.541228 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltqk\" (UniqueName: \"kubernetes.io/projected/418f255a-6db7-4429-8e4e-a91dc259092c-kube-api-access-8ltqk\") pod \"authorino-7498df8756-ft2zw\" (UID: \"418f255a-6db7-4429-8e4e-a91dc259092c\") " pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:57:36.552070 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.552008 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sln6b"] Jun 03 00:57:36.557272 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:57:36.557241 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod203fb17b_dcfd_4b53_98f0_b642c361ca13.slice/crio-7f0557060f249ebb216b6ee78311749dc4f840d94a08d6d725dbcd721773ead4 WatchSource:0}: Error finding container 7f0557060f249ebb216b6ee78311749dc4f840d94a08d6d725dbcd721773ead4: Status 404 returned error can't find the container with id 7f0557060f249ebb216b6ee78311749dc4f840d94a08d6d725dbcd721773ead4 Jun 03 00:57:36.607140 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.606826 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:57:36.778587 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:36.778553 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ft2zw"] Jun 03 00:57:36.784646 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:57:36.783868 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod418f255a_6db7_4429_8e4e_a91dc259092c.slice/crio-3ae94aa50b8f7bb7b583637daf7cecdd0f1f6f3cfa5e58176daf94a140e5f0cd WatchSource:0}: Error finding container 3ae94aa50b8f7bb7b583637daf7cecdd0f1f6f3cfa5e58176daf94a140e5f0cd: Status 404 returned error can't find the container with id 3ae94aa50b8f7bb7b583637daf7cecdd0f1f6f3cfa5e58176daf94a140e5f0cd Jun 03 00:57:37.232028 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:37.231367 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" event={"ID":"203fb17b-dcfd-4b53-98f0-b642c361ca13","Type":"ContainerStarted","Data":"7f0557060f249ebb216b6ee78311749dc4f840d94a08d6d725dbcd721773ead4"} Jun 03 00:57:37.232865 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:37.232836 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ft2zw" event={"ID":"418f255a-6db7-4429-8e4e-a91dc259092c","Type":"ContainerStarted","Data":"3ae94aa50b8f7bb7b583637daf7cecdd0f1f6f3cfa5e58176daf94a140e5f0cd"} Jun 03 00:57:41.253704 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.253662 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" event={"ID":"b2651481-d632-4bb4-a9db-c292bddc8d28","Type":"ContainerStarted","Data":"6f1d655cfd8a6cf8b82f3f7ced8a2c0f6ef29fd1275c64ad02e508e767e494cd"} Jun 03 00:57:41.254228 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.253878 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:41.255415 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.255387 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" event={"ID":"203fb17b-dcfd-4b53-98f0-b642c361ca13","Type":"ContainerStarted","Data":"48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4"} Jun 03 00:57:41.256733 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.256711 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ft2zw" event={"ID":"418f255a-6db7-4429-8e4e-a91dc259092c","Type":"ContainerStarted","Data":"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7"} Jun 03 00:57:41.269446 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.269389 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" podStartSLOduration=0.876669944 podStartE2EDuration="6.269360717s" podCreationTimestamp="2026-06-03 00:57:35 +0000 UTC" firstStartedPulling="2026-06-03 00:57:35.703481989 +0000 UTC m=+511.579415333" lastFinishedPulling="2026-06-03 00:57:41.096172751 +0000 UTC m=+516.972106106" observedRunningTime="2026-06-03 00:57:41.268155203 +0000 UTC m=+517.144088579" watchObservedRunningTime="2026-06-03 00:57:41.269360717 +0000 UTC m=+517.145294084" Jun 03 00:57:41.281943 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.281899 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" podStartSLOduration=0.755271771 podStartE2EDuration="5.281887907s" podCreationTimestamp="2026-06-03 00:57:36 +0000 UTC" firstStartedPulling="2026-06-03 00:57:36.559048633 +0000 UTC m=+512.434981977" lastFinishedPulling="2026-06-03 00:57:41.085664752 +0000 UTC m=+516.961598113" observedRunningTime="2026-06-03 00:57:41.280453888 +0000 UTC m=+517.156387254" watchObservedRunningTime="2026-06-03 00:57:41.281887907 +0000 UTC m=+517.157821272" Jun 03 00:57:41.295638 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.295533 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-ft2zw" podStartSLOduration=0.99450129 podStartE2EDuration="5.295499983s" podCreationTimestamp="2026-06-03 00:57:36 +0000 UTC" firstStartedPulling="2026-06-03 00:57:36.784668333 +0000 UTC m=+512.660601677" lastFinishedPulling="2026-06-03 00:57:41.085667019 +0000 UTC m=+516.961600370" observedRunningTime="2026-06-03 00:57:41.293131358 +0000 UTC m=+517.169064750" watchObservedRunningTime="2026-06-03 00:57:41.295499983 +0000 UTC m=+517.171433351" Jun 03 00:57:41.320704 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:41.320632 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sln6b"] Jun 03 00:57:43.263085 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:43.263038 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" podUID="203fb17b-dcfd-4b53-98f0-b642c361ca13" containerName="authorino" containerID="cri-o://48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4" gracePeriod=30 Jun 03 00:57:43.505814 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:43.505785 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:43.597887 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:43.597799 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwl7t\" (UniqueName: \"kubernetes.io/projected/203fb17b-dcfd-4b53-98f0-b642c361ca13-kube-api-access-jwl7t\") pod \"203fb17b-dcfd-4b53-98f0-b642c361ca13\" (UID: \"203fb17b-dcfd-4b53-98f0-b642c361ca13\") " Jun 03 00:57:43.599973 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:43.599942 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/203fb17b-dcfd-4b53-98f0-b642c361ca13-kube-api-access-jwl7t" (OuterVolumeSpecName: "kube-api-access-jwl7t") pod "203fb17b-dcfd-4b53-98f0-b642c361ca13" (UID: "203fb17b-dcfd-4b53-98f0-b642c361ca13"). InnerVolumeSpecName "kube-api-access-jwl7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:57:43.698973 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:43.698935 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwl7t\" (UniqueName: \"kubernetes.io/projected/203fb17b-dcfd-4b53-98f0-b642c361ca13-kube-api-access-jwl7t\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:57:44.266386 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.266348 2570 generic.go:358] "Generic (PLEG): container finished" podID="203fb17b-dcfd-4b53-98f0-b642c361ca13" containerID="48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4" exitCode=0 Jun 03 00:57:44.266850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.266404 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" Jun 03 00:57:44.266850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.266419 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" event={"ID":"203fb17b-dcfd-4b53-98f0-b642c361ca13","Type":"ContainerDied","Data":"48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4"} Jun 03 00:57:44.266850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.266446 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sln6b" event={"ID":"203fb17b-dcfd-4b53-98f0-b642c361ca13","Type":"ContainerDied","Data":"7f0557060f249ebb216b6ee78311749dc4f840d94a08d6d725dbcd721773ead4"} Jun 03 00:57:44.266850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.266461 2570 scope.go:117] "RemoveContainer" containerID="48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4" Jun 03 00:57:44.274584 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.274567 2570 scope.go:117] "RemoveContainer" containerID="48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4" Jun 03 00:57:44.274858 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:57:44.274837 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4\": container with ID starting with 48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4 not found: ID does not exist" containerID="48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4" Jun 03 00:57:44.274907 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.274860 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4"} err="failed to get container status \"48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4\": rpc error: code = NotFound desc = could not find container \"48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4\": container with ID starting with 48ebf0a5b6358860c17929128425dc6b14a5c6d96b0a672e8aba8c022c2854b4 not found: ID does not exist" Jun 03 00:57:44.286002 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.285979 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sln6b"] Jun 03 00:57:44.291727 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.291705 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sln6b"] Jun 03 00:57:44.660972 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:44.660942 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="203fb17b-dcfd-4b53-98f0-b642c361ca13" path="/var/lib/kubelet/pods/203fb17b-dcfd-4b53-98f0-b642c361ca13/volumes" Jun 03 00:57:49.763045 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:49.762963 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:49.763473 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:49.763234 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" podUID="b2651481-d632-4bb4-a9db-c292bddc8d28" containerName="limitador" containerID="cri-o://6f1d655cfd8a6cf8b82f3f7ced8a2c0f6ef29fd1275c64ad02e508e767e494cd" gracePeriod=30 Jun 03 00:57:49.765327 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:49.765305 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:50.289087 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.289048 2570 generic.go:358] "Generic (PLEG): container finished" podID="b2651481-d632-4bb4-a9db-c292bddc8d28" containerID="6f1d655cfd8a6cf8b82f3f7ced8a2c0f6ef29fd1275c64ad02e508e767e494cd" exitCode=0 Jun 03 00:57:50.289237 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.289125 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" event={"ID":"b2651481-d632-4bb4-a9db-c292bddc8d28","Type":"ContainerDied","Data":"6f1d655cfd8a6cf8b82f3f7ced8a2c0f6ef29fd1275c64ad02e508e767e494cd"} Jun 03 00:57:50.704982 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.704959 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:50.862782 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.862752 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2651481-d632-4bb4-a9db-c292bddc8d28-config-file\") pod \"b2651481-d632-4bb4-a9db-c292bddc8d28\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " Jun 03 00:57:50.863169 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.862812 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfc5z\" (UniqueName: \"kubernetes.io/projected/b2651481-d632-4bb4-a9db-c292bddc8d28-kube-api-access-hfc5z\") pod \"b2651481-d632-4bb4-a9db-c292bddc8d28\" (UID: \"b2651481-d632-4bb4-a9db-c292bddc8d28\") " Jun 03 00:57:50.863169 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.863091 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2651481-d632-4bb4-a9db-c292bddc8d28-config-file" (OuterVolumeSpecName: "config-file") pod "b2651481-d632-4bb4-a9db-c292bddc8d28" (UID: "b2651481-d632-4bb4-a9db-c292bddc8d28"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:57:50.864979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.864954 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2651481-d632-4bb4-a9db-c292bddc8d28-kube-api-access-hfc5z" (OuterVolumeSpecName: "kube-api-access-hfc5z") pod "b2651481-d632-4bb4-a9db-c292bddc8d28" (UID: "b2651481-d632-4bb4-a9db-c292bddc8d28"). InnerVolumeSpecName "kube-api-access-hfc5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:57:50.963751 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.963706 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2651481-d632-4bb4-a9db-c292bddc8d28-config-file\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:57:50.963751 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:50.963745 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfc5z\" (UniqueName: \"kubernetes.io/projected/b2651481-d632-4bb4-a9db-c292bddc8d28-kube-api-access-hfc5z\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:57:51.293411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.293312 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" event={"ID":"b2651481-d632-4bb4-a9db-c292bddc8d28","Type":"ContainerDied","Data":"aca06d752b8da11694f4453c48109996c8dd29fc13e55c6bb93efea93ffc1202"} Jun 03 00:57:51.293411 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.293346 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-m4zpp" Jun 03 00:57:51.293654 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.293352 2570 scope.go:117] "RemoveContainer" containerID="6f1d655cfd8a6cf8b82f3f7ced8a2c0f6ef29fd1275c64ad02e508e767e494cd" Jun 03 00:57:51.313766 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.313741 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:51.316760 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.316732 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-m4zpp"] Jun 03 00:57:51.731322 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731271 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-zj8nd"] Jun 03 00:57:51.731626 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731611 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="203fb17b-dcfd-4b53-98f0-b642c361ca13" containerName="authorino" Jun 03 00:57:51.731626 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731627 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="203fb17b-dcfd-4b53-98f0-b642c361ca13" containerName="authorino" Jun 03 00:57:51.731785 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731644 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2651481-d632-4bb4-a9db-c292bddc8d28" containerName="limitador" Jun 03 00:57:51.731785 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731650 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2651481-d632-4bb4-a9db-c292bddc8d28" containerName="limitador" Jun 03 00:57:51.731785 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731696 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2651481-d632-4bb4-a9db-c292bddc8d28" containerName="limitador" Jun 03 00:57:51.731785 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.731708 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="203fb17b-dcfd-4b53-98f0-b642c361ca13" containerName="authorino" Jun 03 00:57:51.736056 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.736033 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:51.738595 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.738573 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 00:57:51.741042 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.741019 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-zj8nd"] Jun 03 00:57:51.870485 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.870447 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3752ae53-2f18-406c-b423-66c7c4c1ebf1-data\") pod \"postgres-68c4fbbd6f-zj8nd\" (UID: \"3752ae53-2f18-406c-b423-66c7c4c1ebf1\") " pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:51.870898 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.870554 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntbd\" (UniqueName: \"kubernetes.io/projected/3752ae53-2f18-406c-b423-66c7c4c1ebf1-kube-api-access-vntbd\") pod \"postgres-68c4fbbd6f-zj8nd\" (UID: \"3752ae53-2f18-406c-b423-66c7c4c1ebf1\") " pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:51.971031 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.970999 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3752ae53-2f18-406c-b423-66c7c4c1ebf1-data\") pod \"postgres-68c4fbbd6f-zj8nd\" (UID: \"3752ae53-2f18-406c-b423-66c7c4c1ebf1\") " pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:51.971197 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.971054 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vntbd\" (UniqueName: \"kubernetes.io/projected/3752ae53-2f18-406c-b423-66c7c4c1ebf1-kube-api-access-vntbd\") pod \"postgres-68c4fbbd6f-zj8nd\" (UID: \"3752ae53-2f18-406c-b423-66c7c4c1ebf1\") " pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:51.971505 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.971477 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3752ae53-2f18-406c-b423-66c7c4c1ebf1-data\") pod \"postgres-68c4fbbd6f-zj8nd\" (UID: \"3752ae53-2f18-406c-b423-66c7c4c1ebf1\") " pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:51.978947 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:51.978918 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntbd\" (UniqueName: \"kubernetes.io/projected/3752ae53-2f18-406c-b423-66c7c4c1ebf1-kube-api-access-vntbd\") pod \"postgres-68c4fbbd6f-zj8nd\" (UID: \"3752ae53-2f18-406c-b423-66c7c4c1ebf1\") " pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:52.049024 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:52.048940 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:52.174777 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:52.174711 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-zj8nd"] Jun 03 00:57:52.176960 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:57:52.176932 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3752ae53_2f18_406c_b423_66c7c4c1ebf1.slice/crio-78e14582ef7984198804dc7d3c9996ccb5651173d16955dbdf5104c82a6d3be6 WatchSource:0}: Error finding container 78e14582ef7984198804dc7d3c9996ccb5651173d16955dbdf5104c82a6d3be6: Status 404 returned error can't find the container with id 78e14582ef7984198804dc7d3c9996ccb5651173d16955dbdf5104c82a6d3be6 Jun 03 00:57:52.298932 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:52.298899 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" event={"ID":"3752ae53-2f18-406c-b423-66c7c4c1ebf1","Type":"ContainerStarted","Data":"78e14582ef7984198804dc7d3c9996ccb5651173d16955dbdf5104c82a6d3be6"} Jun 03 00:57:52.657149 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:52.657117 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2651481-d632-4bb4-a9db-c292bddc8d28" path="/var/lib/kubelet/pods/b2651481-d632-4bb4-a9db-c292bddc8d28/volumes" Jun 03 00:57:55.309972 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:55.309939 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" event={"ID":"3752ae53-2f18-406c-b423-66c7c4c1ebf1","Type":"ContainerStarted","Data":"4766e3480e804cf0d617ab99c5444591ae63a735037a61661d1e341e46c70dce"} Jun 03 00:57:55.310437 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:55.310056 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:57:55.326122 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:57:55.326064 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" podStartSLOduration=1.6955035459999999 podStartE2EDuration="4.326049518s" podCreationTimestamp="2026-06-03 00:57:51 +0000 UTC" firstStartedPulling="2026-06-03 00:57:52.178352275 +0000 UTC m=+528.054285620" lastFinishedPulling="2026-06-03 00:57:54.808898234 +0000 UTC m=+530.684831592" observedRunningTime="2026-06-03 00:57:55.3246356 +0000 UTC m=+531.200568959" watchObservedRunningTime="2026-06-03 00:57:55.326049518 +0000 UTC m=+531.201982883" Jun 03 00:58:01.345751 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:01.345723 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-zj8nd" Jun 03 00:58:16.003656 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.003618 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-4cwdp"] Jun 03 00:58:16.013194 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.013166 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" Jun 03 00:58:16.016213 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.016187 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-r7skl\"" Jun 03 00:58:16.016455 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.016431 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 00:58:16.016604 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.016302 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 00:58:16.017088 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.017065 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-4cwdp"] Jun 03 00:58:16.077390 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.077350 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gj7s\" (UniqueName: \"kubernetes.io/projected/1c37595f-0c78-443d-824c-7f063cc5a806-kube-api-access-6gj7s\") pod \"keycloak-operator-7864d68cbd-4cwdp\" (UID: \"1c37595f-0c78-443d-824c-7f063cc5a806\") " pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" Jun 03 00:58:16.178201 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.178156 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gj7s\" (UniqueName: \"kubernetes.io/projected/1c37595f-0c78-443d-824c-7f063cc5a806-kube-api-access-6gj7s\") pod \"keycloak-operator-7864d68cbd-4cwdp\" (UID: \"1c37595f-0c78-443d-824c-7f063cc5a806\") " pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" Jun 03 00:58:16.190039 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.190013 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gj7s\" (UniqueName: \"kubernetes.io/projected/1c37595f-0c78-443d-824c-7f063cc5a806-kube-api-access-6gj7s\") pod \"keycloak-operator-7864d68cbd-4cwdp\" (UID: \"1c37595f-0c78-443d-824c-7f063cc5a806\") " pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" Jun 03 00:58:16.323657 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.323582 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" Jun 03 00:58:16.454559 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:16.454504 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-4cwdp"] Jun 03 00:58:16.458006 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:58:16.457963 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c37595f_0c78_443d_824c_7f063cc5a806.slice/crio-db5ab6198a732323d289b451bfcc32d56a663106f4baecaf3dd95f95b38e7c81 WatchSource:0}: Error finding container db5ab6198a732323d289b451bfcc32d56a663106f4baecaf3dd95f95b38e7c81: Status 404 returned error can't find the container with id db5ab6198a732323d289b451bfcc32d56a663106f4baecaf3dd95f95b38e7c81 Jun 03 00:58:17.388314 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:17.388249 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" event={"ID":"1c37595f-0c78-443d-824c-7f063cc5a806","Type":"ContainerStarted","Data":"db5ab6198a732323d289b451bfcc32d56a663106f4baecaf3dd95f95b38e7c81"} Jun 03 00:58:22.407081 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:22.407052 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" event={"ID":"1c37595f-0c78-443d-824c-7f063cc5a806","Type":"ContainerStarted","Data":"b28d9e1ba07f4b64b05f56ad27fb12f0ed5d5bad47b4712c696eb631fbe35097"} Jun 03 00:58:22.422928 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:58:22.422880 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-4cwdp" podStartSLOduration=1.536747439 podStartE2EDuration="7.422864497s" podCreationTimestamp="2026-06-03 00:58:15 +0000 UTC" firstStartedPulling="2026-06-03 00:58:16.459376049 +0000 UTC m=+552.335309394" lastFinishedPulling="2026-06-03 00:58:22.345493108 +0000 UTC m=+558.221426452" observedRunningTime="2026-06-03 00:58:22.421376453 +0000 UTC m=+558.297309813" watchObservedRunningTime="2026-06-03 00:58:22.422864497 +0000 UTC m=+558.298797862" Jun 03 00:59:01.803954 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.803924 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-57b89"] Jun 03 00:59:01.806587 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.806570 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:01.812161 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.812136 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-57b89"] Jun 03 00:59:01.861875 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.861842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c92js\" (UniqueName: \"kubernetes.io/projected/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c-kube-api-access-c92js\") pod \"authorino-8b475cf9f-57b89\" (UID: \"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c\") " pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:01.963091 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.963048 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c92js\" (UniqueName: \"kubernetes.io/projected/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c-kube-api-access-c92js\") pod \"authorino-8b475cf9f-57b89\" (UID: \"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c\") " pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:01.973561 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.973533 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c92js\" (UniqueName: \"kubernetes.io/projected/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c-kube-api-access-c92js\") pod \"authorino-8b475cf9f-57b89\" (UID: \"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c\") " pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:01.983794 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.983769 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-57b89"] Jun 03 00:59:01.984005 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:01.983993 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:02.010004 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.009972 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-8jhd8"] Jun 03 00:59:02.012504 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.012486 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.015090 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.015067 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 00:59:02.019433 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.019380 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-8jhd8"] Jun 03 00:59:02.057135 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.056917 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-8jhd8"] Jun 03 00:59:02.057302 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:59:02.057155 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-htv8l tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-8jhd8" podUID="6730a3da-bb6c-4004-bb85-a5cc69396782" Jun 03 00:59:02.064333 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.064306 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6730a3da-bb6c-4004-bb85-a5cc69396782-tls-cert\") pod \"authorino-56fdd757f5-8jhd8\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.064486 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.064354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htv8l\" (UniqueName: \"kubernetes.io/projected/6730a3da-bb6c-4004-bb85-a5cc69396782-kube-api-access-htv8l\") pod \"authorino-56fdd757f5-8jhd8\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.082398 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.082364 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6677465765-gkq8v"] Jun 03 00:59:02.084872 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.084842 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.094290 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.094259 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6677465765-gkq8v"] Jun 03 00:59:02.115440 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.115417 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-57b89"] Jun 03 00:59:02.117816 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:59:02.117789 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa34ffc4_42e7_4e98_b7f3_e9ea449d4b5c.slice/crio-ea78435b290f7e1e6e1f1315af0d3001e8bf350fa4f2a85fb05f88f6b0c8322d WatchSource:0}: Error finding container ea78435b290f7e1e6e1f1315af0d3001e8bf350fa4f2a85fb05f88f6b0c8322d: Status 404 returned error can't find the container with id ea78435b290f7e1e6e1f1315af0d3001e8bf350fa4f2a85fb05f88f6b0c8322d Jun 03 00:59:02.165486 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.165444 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htv8l\" (UniqueName: \"kubernetes.io/projected/6730a3da-bb6c-4004-bb85-a5cc69396782-kube-api-access-htv8l\") pod \"authorino-56fdd757f5-8jhd8\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.165685 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.165497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-tls-cert\") pod \"authorino-6677465765-gkq8v\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.165685 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.165560 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptv2c\" (UniqueName: \"kubernetes.io/projected/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-kube-api-access-ptv2c\") pod \"authorino-6677465765-gkq8v\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.165685 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.165584 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6730a3da-bb6c-4004-bb85-a5cc69396782-tls-cert\") pod \"authorino-56fdd757f5-8jhd8\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.168133 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.168109 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6730a3da-bb6c-4004-bb85-a5cc69396782-tls-cert\") pod \"authorino-56fdd757f5-8jhd8\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.178850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.178827 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htv8l\" (UniqueName: \"kubernetes.io/projected/6730a3da-bb6c-4004-bb85-a5cc69396782-kube-api-access-htv8l\") pod \"authorino-56fdd757f5-8jhd8\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.266027 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.265984 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-tls-cert\") pod \"authorino-6677465765-gkq8v\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.266199 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.266051 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptv2c\" (UniqueName: \"kubernetes.io/projected/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-kube-api-access-ptv2c\") pod \"authorino-6677465765-gkq8v\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.268620 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.268585 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-tls-cert\") pod \"authorino-6677465765-gkq8v\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.273809 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.273787 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptv2c\" (UniqueName: \"kubernetes.io/projected/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-kube-api-access-ptv2c\") pod \"authorino-6677465765-gkq8v\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.396907 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.396873 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 00:59:02.524150 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.524123 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6677465765-gkq8v"] Jun 03 00:59:02.526579 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:59:02.526547 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80f91ca2_f4fd_4c9d_af04_a0b1ffcbbbb1.slice/crio-f8491ac46e78699f43b5c2cf0ee8d05741c185cf39460bf506818d454d831704 WatchSource:0}: Error finding container f8491ac46e78699f43b5c2cf0ee8d05741c185cf39460bf506818d454d831704: Status 404 returned error can't find the container with id f8491ac46e78699f43b5c2cf0ee8d05741c185cf39460bf506818d454d831704 Jun 03 00:59:02.546190 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.546130 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6677465765-gkq8v" event={"ID":"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1","Type":"ContainerStarted","Data":"f8491ac46e78699f43b5c2cf0ee8d05741c185cf39460bf506818d454d831704"} Jun 03 00:59:02.547420 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.547398 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.547537 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.547494 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-57b89" event={"ID":"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c","Type":"ContainerStarted","Data":"ea78435b290f7e1e6e1f1315af0d3001e8bf350fa4f2a85fb05f88f6b0c8322d"} Jun 03 00:59:02.554060 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.554036 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:02.670142 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.670040 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6730a3da-bb6c-4004-bb85-a5cc69396782-tls-cert\") pod \"6730a3da-bb6c-4004-bb85-a5cc69396782\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " Jun 03 00:59:02.670142 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.670093 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htv8l\" (UniqueName: \"kubernetes.io/projected/6730a3da-bb6c-4004-bb85-a5cc69396782-kube-api-access-htv8l\") pod \"6730a3da-bb6c-4004-bb85-a5cc69396782\" (UID: \"6730a3da-bb6c-4004-bb85-a5cc69396782\") " Jun 03 00:59:02.672434 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.672403 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6730a3da-bb6c-4004-bb85-a5cc69396782-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6730a3da-bb6c-4004-bb85-a5cc69396782" (UID: "6730a3da-bb6c-4004-bb85-a5cc69396782"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:59:02.672706 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.672684 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6730a3da-bb6c-4004-bb85-a5cc69396782-kube-api-access-htv8l" (OuterVolumeSpecName: "kube-api-access-htv8l") pod "6730a3da-bb6c-4004-bb85-a5cc69396782" (UID: "6730a3da-bb6c-4004-bb85-a5cc69396782"). InnerVolumeSpecName "kube-api-access-htv8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:59:02.770923 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.770873 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6730a3da-bb6c-4004-bb85-a5cc69396782-tls-cert\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:59:02.770923 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:02.770913 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htv8l\" (UniqueName: \"kubernetes.io/projected/6730a3da-bb6c-4004-bb85-a5cc69396782-kube-api-access-htv8l\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:59:03.552590 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.552552 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6677465765-gkq8v" event={"ID":"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1","Type":"ContainerStarted","Data":"4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a"} Jun 03 00:59:03.553916 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.553886 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-57b89" event={"ID":"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c","Type":"ContainerStarted","Data":"7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191"} Jun 03 00:59:03.553916 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.553911 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-8jhd8" Jun 03 00:59:03.554065 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.553917 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-57b89" podUID="aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" containerName="authorino" containerID="cri-o://7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191" gracePeriod=30 Jun 03 00:59:03.568110 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.568024 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6677465765-gkq8v" podStartSLOduration=1.319954279 podStartE2EDuration="1.568007795s" podCreationTimestamp="2026-06-03 00:59:02 +0000 UTC" firstStartedPulling="2026-06-03 00:59:02.527872351 +0000 UTC m=+598.403805695" lastFinishedPulling="2026-06-03 00:59:02.775925854 +0000 UTC m=+598.651859211" observedRunningTime="2026-06-03 00:59:03.567109711 +0000 UTC m=+599.443043078" watchObservedRunningTime="2026-06-03 00:59:03.568007795 +0000 UTC m=+599.443941164" Jun 03 00:59:03.581501 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.581436 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-57b89" podStartSLOduration=2.154846923 podStartE2EDuration="2.581418529s" podCreationTimestamp="2026-06-03 00:59:01 +0000 UTC" firstStartedPulling="2026-06-03 00:59:02.119016508 +0000 UTC m=+597.994949852" lastFinishedPulling="2026-06-03 00:59:02.545588101 +0000 UTC m=+598.421521458" observedRunningTime="2026-06-03 00:59:03.58093089 +0000 UTC m=+599.456864257" watchObservedRunningTime="2026-06-03 00:59:03.581418529 +0000 UTC m=+599.457351896" Jun 03 00:59:03.597939 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.597905 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ft2zw"] Jun 03 00:59:03.598125 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.598105 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-ft2zw" podUID="418f255a-6db7-4429-8e4e-a91dc259092c" containerName="authorino" containerID="cri-o://f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7" gracePeriod=30 Jun 03 00:59:03.683990 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.683956 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-8jhd8"] Jun 03 00:59:03.687118 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.687088 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-8jhd8"] Jun 03 00:59:03.861813 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.861789 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:03.864886 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.864863 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:59:03.980850 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.980823 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c92js\" (UniqueName: \"kubernetes.io/projected/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c-kube-api-access-c92js\") pod \"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c\" (UID: \"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c\") " Jun 03 00:59:03.980993 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.980917 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltqk\" (UniqueName: \"kubernetes.io/projected/418f255a-6db7-4429-8e4e-a91dc259092c-kube-api-access-8ltqk\") pod \"418f255a-6db7-4429-8e4e-a91dc259092c\" (UID: \"418f255a-6db7-4429-8e4e-a91dc259092c\") " Jun 03 00:59:03.983202 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.983169 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/418f255a-6db7-4429-8e4e-a91dc259092c-kube-api-access-8ltqk" (OuterVolumeSpecName: "kube-api-access-8ltqk") pod "418f255a-6db7-4429-8e4e-a91dc259092c" (UID: "418f255a-6db7-4429-8e4e-a91dc259092c"). InnerVolumeSpecName "kube-api-access-8ltqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:59:03.983308 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:03.983217 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c-kube-api-access-c92js" (OuterVolumeSpecName: "kube-api-access-c92js") pod "aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" (UID: "aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c"). InnerVolumeSpecName "kube-api-access-c92js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:59:04.082406 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.082361 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c92js\" (UniqueName: \"kubernetes.io/projected/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c-kube-api-access-c92js\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:59:04.082406 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.082396 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltqk\" (UniqueName: \"kubernetes.io/projected/418f255a-6db7-4429-8e4e-a91dc259092c-kube-api-access-8ltqk\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:59:04.558143 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.558101 2570 generic.go:358] "Generic (PLEG): container finished" podID="418f255a-6db7-4429-8e4e-a91dc259092c" containerID="f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7" exitCode=0 Jun 03 00:59:04.558611 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.558166 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ft2zw" Jun 03 00:59:04.558611 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.558185 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ft2zw" event={"ID":"418f255a-6db7-4429-8e4e-a91dc259092c","Type":"ContainerDied","Data":"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7"} Jun 03 00:59:04.558611 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.558224 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ft2zw" event={"ID":"418f255a-6db7-4429-8e4e-a91dc259092c","Type":"ContainerDied","Data":"3ae94aa50b8f7bb7b583637daf7cecdd0f1f6f3cfa5e58176daf94a140e5f0cd"} Jun 03 00:59:04.558611 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.558245 2570 scope.go:117] "RemoveContainer" containerID="f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7" Jun 03 00:59:04.559634 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.559194 2570 generic.go:358] "Generic (PLEG): container finished" podID="aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" containerID="7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191" exitCode=0 Jun 03 00:59:04.559634 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.559266 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-57b89" Jun 03 00:59:04.559634 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.559300 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-57b89" event={"ID":"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c","Type":"ContainerDied","Data":"7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191"} Jun 03 00:59:04.559634 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.559328 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-57b89" event={"ID":"aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c","Type":"ContainerDied","Data":"ea78435b290f7e1e6e1f1315af0d3001e8bf350fa4f2a85fb05f88f6b0c8322d"} Jun 03 00:59:04.569795 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.569773 2570 scope.go:117] "RemoveContainer" containerID="f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7" Jun 03 00:59:04.569893 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:59:04.569779 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7\": container with ID starting with f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7 not found: ID does not exist" containerID="f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7" Jun 03 00:59:04.569893 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:59:04.569882 2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="get container status: runtime container status: rpc error: code = NotFound desc = could not find container \"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7\": container with ID starting with f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7 not found: ID does not exist" Jun 03 00:59:04.570334 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.570194 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7"} err="failed to get container status \"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7\": rpc error: code = NotFound desc = could not find container \"f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7\": container with ID starting with f4324341ee24bf7dc27605119d4681d4bb1f7ea5b7af5b7eb130315cb33c40b7 not found: ID does not exist" Jun 03 00:59:04.570334 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.570224 2570 scope.go:117] "RemoveContainer" containerID="7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191" Jun 03 00:59:04.578865 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.578847 2570 scope.go:117] "RemoveContainer" containerID="7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191" Jun 03 00:59:04.579086 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:59:04.579063 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191\": container with ID starting with 7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191 not found: ID does not exist" containerID="7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191" Jun 03 00:59:04.579153 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.579091 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191"} err="failed to get container status \"7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191\": rpc error: code = NotFound desc = could not find container \"7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191\": container with ID starting with 7b92d8e8d876e4363afd58db246a3ac6a53697f8850047b483b47a8fbe857191 not found: ID does not exist" Jun 03 00:59:04.585059 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.585034 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-57b89"] Jun 03 00:59:04.588163 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.588137 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-57b89"] Jun 03 00:59:04.598976 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.598934 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ft2zw"] Jun 03 00:59:04.600403 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.600382 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-ft2zw"] Jun 03 00:59:04.660055 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.660022 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="418f255a-6db7-4429-8e4e-a91dc259092c" path="/var/lib/kubelet/pods/418f255a-6db7-4429-8e4e-a91dc259092c/volumes" Jun 03 00:59:04.660392 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.660379 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6730a3da-bb6c-4004-bb85-a5cc69396782" path="/var/lib/kubelet/pods/6730a3da-bb6c-4004-bb85-a5cc69396782/volumes" Jun 03 00:59:04.660599 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:04.660587 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" path="/var/lib/kubelet/pods/aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c/volumes" Jun 03 00:59:06.721791 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.721757 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69db667b85-2kjjf"] Jun 03 00:59:06.722979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.722066 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="418f255a-6db7-4429-8e4e-a91dc259092c" containerName="authorino" Jun 03 00:59:06.722979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.722076 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="418f255a-6db7-4429-8e4e-a91dc259092c" containerName="authorino" Jun 03 00:59:06.722979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.722088 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" containerName="authorino" Jun 03 00:59:06.722979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.722094 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" containerName="authorino" Jun 03 00:59:06.722979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.722144 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa34ffc4-42e7-4e98-b7f3-e9ea449d4b5c" containerName="authorino" Jun 03 00:59:06.722979 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.722154 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="418f255a-6db7-4429-8e4e-a91dc259092c" containerName="authorino" Jun 03 00:59:06.724151 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.724136 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:06.726778 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.726752 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hvggr\"" Jun 03 00:59:06.726881 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.726796 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 00:59:06.732442 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.732420 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69db667b85-2kjjf"] Jun 03 00:59:06.807248 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.807215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbh74\" (UniqueName: \"kubernetes.io/projected/650c3da3-0595-4a7f-80e3-9f7cad05728b-kube-api-access-pbh74\") pod \"maas-controller-69db667b85-2kjjf\" (UID: \"650c3da3-0595-4a7f-80e3-9f7cad05728b\") " pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:06.884074 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.884029 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-mkrgg"] Jun 03 00:59:06.886330 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.886314 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:06.897145 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.897119 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-mkrgg"] Jun 03 00:59:06.907770 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.907744 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbh74\" (UniqueName: \"kubernetes.io/projected/650c3da3-0595-4a7f-80e3-9f7cad05728b-kube-api-access-pbh74\") pod \"maas-controller-69db667b85-2kjjf\" (UID: \"650c3da3-0595-4a7f-80e3-9f7cad05728b\") " pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:06.915990 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:06.915966 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbh74\" (UniqueName: \"kubernetes.io/projected/650c3da3-0595-4a7f-80e3-9f7cad05728b-kube-api-access-pbh74\") pod \"maas-controller-69db667b85-2kjjf\" (UID: \"650c3da3-0595-4a7f-80e3-9f7cad05728b\") " pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:07.009079 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.008996 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2ww8\" (UniqueName: \"kubernetes.io/projected/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82-kube-api-access-n2ww8\") pod \"maas-controller-7f6bb74d9f-mkrgg\" (UID: \"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82\") " pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:07.035073 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.035038 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:07.109739 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.109706 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2ww8\" (UniqueName: \"kubernetes.io/projected/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82-kube-api-access-n2ww8\") pod \"maas-controller-7f6bb74d9f-mkrgg\" (UID: \"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82\") " pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:07.119927 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.119896 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2ww8\" (UniqueName: \"kubernetes.io/projected/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82-kube-api-access-n2ww8\") pod \"maas-controller-7f6bb74d9f-mkrgg\" (UID: \"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82\") " pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:07.161288 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.161262 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69db667b85-2kjjf"] Jun 03 00:59:07.163063 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:59:07.163031 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650c3da3_0595_4a7f_80e3_9f7cad05728b.slice/crio-373d0a8cbb62ab4472e6ba1b0c77f2338d7fbe0008c4760e1c8a7c25c01a4489 WatchSource:0}: Error finding container 373d0a8cbb62ab4472e6ba1b0c77f2338d7fbe0008c4760e1c8a7c25c01a4489: Status 404 returned error can't find the container with id 373d0a8cbb62ab4472e6ba1b0c77f2338d7fbe0008c4760e1c8a7c25c01a4489 Jun 03 00:59:07.164323 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.164306 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:59:07.196842 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.196813 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:07.326290 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.326170 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-mkrgg"] Jun 03 00:59:07.328796 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:59:07.328767 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40ef0b4_7c48_4dd4_ad78_cfea10bdda82.slice/crio-2dd135cd685a565256582677764647f86bb4af04146f543a59f00f86ca4a31ba WatchSource:0}: Error finding container 2dd135cd685a565256582677764647f86bb4af04146f543a59f00f86ca4a31ba: Status 404 returned error can't find the container with id 2dd135cd685a565256582677764647f86bb4af04146f543a59f00f86ca4a31ba Jun 03 00:59:07.572597 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.572496 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69db667b85-2kjjf" event={"ID":"650c3da3-0595-4a7f-80e3-9f7cad05728b","Type":"ContainerStarted","Data":"373d0a8cbb62ab4472e6ba1b0c77f2338d7fbe0008c4760e1c8a7c25c01a4489"} Jun 03 00:59:07.573387 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:07.573364 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" event={"ID":"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82","Type":"ContainerStarted","Data":"2dd135cd685a565256582677764647f86bb4af04146f543a59f00f86ca4a31ba"} Jun 03 00:59:10.587156 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:10.587115 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" event={"ID":"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82","Type":"ContainerStarted","Data":"a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09"} Jun 03 00:59:10.587156 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:10.587164 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:10.588599 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:10.588575 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69db667b85-2kjjf" event={"ID":"650c3da3-0595-4a7f-80e3-9f7cad05728b","Type":"ContainerStarted","Data":"c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c"} Jun 03 00:59:10.588730 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:10.588700 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:10.604464 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:10.604420 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" podStartSLOduration=2.028242594 podStartE2EDuration="4.604407688s" podCreationTimestamp="2026-06-03 00:59:06 +0000 UTC" firstStartedPulling="2026-06-03 00:59:07.330027147 +0000 UTC m=+603.205960491" lastFinishedPulling="2026-06-03 00:59:09.906192226 +0000 UTC m=+605.782125585" observedRunningTime="2026-06-03 00:59:10.602664197 +0000 UTC m=+606.478597562" watchObservedRunningTime="2026-06-03 00:59:10.604407688 +0000 UTC m=+606.480341054" Jun 03 00:59:10.618432 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:10.618391 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69db667b85-2kjjf" podStartSLOduration=1.866513475 podStartE2EDuration="4.618379497s" podCreationTimestamp="2026-06-03 00:59:06 +0000 UTC" firstStartedPulling="2026-06-03 00:59:07.164438291 +0000 UTC m=+603.040371652" lastFinishedPulling="2026-06-03 00:59:09.916304326 +0000 UTC m=+605.792237674" observedRunningTime="2026-06-03 00:59:10.616702647 +0000 UTC m=+606.492636012" watchObservedRunningTime="2026-06-03 00:59:10.618379497 +0000 UTC m=+606.494312873" Jun 03 00:59:21.597555 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:21.597467 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:21.597555 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:21.597546 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 00:59:21.653310 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:21.653279 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69db667b85-2kjjf"] Jun 03 00:59:21.653506 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:21.653469 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-69db667b85-2kjjf" podUID="650c3da3-0595-4a7f-80e3-9f7cad05728b" containerName="manager" containerID="cri-o://c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c" gracePeriod=30 Jun 03 00:59:21.900881 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:21.900851 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:22.042279 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.042242 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbh74\" (UniqueName: \"kubernetes.io/projected/650c3da3-0595-4a7f-80e3-9f7cad05728b-kube-api-access-pbh74\") pod \"650c3da3-0595-4a7f-80e3-9f7cad05728b\" (UID: \"650c3da3-0595-4a7f-80e3-9f7cad05728b\") " Jun 03 00:59:22.044617 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.044585 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/650c3da3-0595-4a7f-80e3-9f7cad05728b-kube-api-access-pbh74" (OuterVolumeSpecName: "kube-api-access-pbh74") pod "650c3da3-0595-4a7f-80e3-9f7cad05728b" (UID: "650c3da3-0595-4a7f-80e3-9f7cad05728b"). InnerVolumeSpecName "kube-api-access-pbh74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:59:22.143375 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.143284 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbh74\" (UniqueName: \"kubernetes.io/projected/650c3da3-0595-4a7f-80e3-9f7cad05728b-kube-api-access-pbh74\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 00:59:22.638078 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.638042 2570 generic.go:358] "Generic (PLEG): container finished" podID="650c3da3-0595-4a7f-80e3-9f7cad05728b" containerID="c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c" exitCode=0 Jun 03 00:59:22.638564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.638092 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69db667b85-2kjjf" event={"ID":"650c3da3-0595-4a7f-80e3-9f7cad05728b","Type":"ContainerDied","Data":"c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c"} Jun 03 00:59:22.638564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.638100 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69db667b85-2kjjf" Jun 03 00:59:22.638564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.638118 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69db667b85-2kjjf" event={"ID":"650c3da3-0595-4a7f-80e3-9f7cad05728b","Type":"ContainerDied","Data":"373d0a8cbb62ab4472e6ba1b0c77f2338d7fbe0008c4760e1c8a7c25c01a4489"} Jun 03 00:59:22.638564 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.638138 2570 scope.go:117] "RemoveContainer" containerID="c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c" Jun 03 00:59:22.646301 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.646284 2570 scope.go:117] "RemoveContainer" containerID="c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c" Jun 03 00:59:22.646602 ip-10-0-140-130 kubenswrapper[2570]: E0603 00:59:22.646578 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c\": container with ID starting with c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c not found: ID does not exist" containerID="c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c" Jun 03 00:59:22.646670 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.646614 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c"} err="failed to get container status \"c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c\": rpc error: code = NotFound desc = could not find container \"c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c\": container with ID starting with c6436cf6995eba15e24ff398cd20302129ce8ca68613c527c15ddfe36344817c not found: ID does not exist" Jun 03 00:59:22.659599 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.659574 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69db667b85-2kjjf"] Jun 03 00:59:22.661513 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:22.661490 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69db667b85-2kjjf"] Jun 03 00:59:24.656844 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:24.656812 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="650c3da3-0595-4a7f-80e3-9f7cad05728b" path="/var/lib/kubelet/pods/650c3da3-0595-4a7f-80e3-9f7cad05728b/volumes" Jun 03 00:59:41.503259 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.503222 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-k4wcw"] Jun 03 00:59:41.503752 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.503554 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="650c3da3-0595-4a7f-80e3-9f7cad05728b" containerName="manager" Jun 03 00:59:41.503752 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.503566 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="650c3da3-0595-4a7f-80e3-9f7cad05728b" containerName="manager" Jun 03 00:59:41.503752 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.503622 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="650c3da3-0595-4a7f-80e3-9f7cad05728b" containerName="manager" Jun 03 00:59:41.507727 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.507708 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:41.510236 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.510210 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 00:59:41.511641 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.511619 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wn8qr\"" Jun 03 00:59:41.513332 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.513315 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-k4wcw"] Jun 03 00:59:41.606674 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.606640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwd8\" (UniqueName: \"kubernetes.io/projected/dc7b82d8-a9a0-4403-9e07-a8fd553c9696-kube-api-access-jmwd8\") pod \"payload-processing-58b6c8fdc7-k4wcw\" (UID: \"dc7b82d8-a9a0-4403-9e07-a8fd553c9696\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:41.707179 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.707140 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwd8\" (UniqueName: \"kubernetes.io/projected/dc7b82d8-a9a0-4403-9e07-a8fd553c9696-kube-api-access-jmwd8\") pod \"payload-processing-58b6c8fdc7-k4wcw\" (UID: \"dc7b82d8-a9a0-4403-9e07-a8fd553c9696\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:41.730422 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.730392 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwd8\" (UniqueName: \"kubernetes.io/projected/dc7b82d8-a9a0-4403-9e07-a8fd553c9696-kube-api-access-jmwd8\") pod \"payload-processing-58b6c8fdc7-k4wcw\" (UID: \"dc7b82d8-a9a0-4403-9e07-a8fd553c9696\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:41.820189 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.820104 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:41.952367 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:41.952230 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-k4wcw"] Jun 03 00:59:41.955562 ip-10-0-140-130 kubenswrapper[2570]: W0603 00:59:41.955501 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7b82d8_a9a0_4403_9e07_a8fd553c9696.slice/crio-a3bf96ca038dd0e05b2e99f53983cd3c88cb3c39d627e8c016b26223f59183e6 WatchSource:0}: Error finding container a3bf96ca038dd0e05b2e99f53983cd3c88cb3c39d627e8c016b26223f59183e6: Status 404 returned error can't find the container with id a3bf96ca038dd0e05b2e99f53983cd3c88cb3c39d627e8c016b26223f59183e6 Jun 03 00:59:42.737719 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:42.737666 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" event={"ID":"dc7b82d8-a9a0-4403-9e07-a8fd553c9696","Type":"ContainerStarted","Data":"a3bf96ca038dd0e05b2e99f53983cd3c88cb3c39d627e8c016b26223f59183e6"} Jun 03 00:59:45.751337 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:45.751298 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" event={"ID":"dc7b82d8-a9a0-4403-9e07-a8fd553c9696","Type":"ContainerStarted","Data":"c3f6a8943081a7858b14560332a343a9de1904ad1ddc1195d764f14cf1b436a1"} Jun 03 00:59:45.751751 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:45.751370 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:56.757131 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:56.757102 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" Jun 03 00:59:56.774464 ip-10-0-140-130 kubenswrapper[2570]: I0603 00:59:56.774410 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-k4wcw" podStartSLOduration=13.039052034 podStartE2EDuration="15.774395539s" podCreationTimestamp="2026-06-03 00:59:41 +0000 UTC" firstStartedPulling="2026-06-03 00:59:41.957448631 +0000 UTC m=+637.833381974" lastFinishedPulling="2026-06-03 00:59:44.692792135 +0000 UTC m=+640.568725479" observedRunningTime="2026-06-03 00:59:45.790912108 +0000 UTC m=+641.666845473" watchObservedRunningTime="2026-06-03 00:59:56.774395539 +0000 UTC m=+652.650328904" Jun 03 01:00:39.881445 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.881405 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85995bf767-spqpb"] Jun 03 01:00:39.884577 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.884559 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:39.887087 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.887068 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 01:00:39.892997 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.892974 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85995bf767-spqpb"] Jun 03 01:00:39.926321 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.926278 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-oidc-ca\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:39.926507 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.926354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-tls-cert\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:39.926507 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:39.926402 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2v9\" (UniqueName: \"kubernetes.io/projected/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-kube-api-access-jt2v9\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.027204 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.027159 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-oidc-ca\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.027439 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.027247 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-tls-cert\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.027439 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.027285 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2v9\" (UniqueName: \"kubernetes.io/projected/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-kube-api-access-jt2v9\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.027858 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.027829 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-oidc-ca\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.029823 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.029797 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-tls-cert\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.034801 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.034776 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2v9\" (UniqueName: \"kubernetes.io/projected/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-kube-api-access-jt2v9\") pod \"authorino-85995bf767-spqpb\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.194312 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.194221 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:00:40.323375 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.323243 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85995bf767-spqpb"] Jun 03 01:00:40.326238 ip-10-0-140-130 kubenswrapper[2570]: W0603 01:00:40.326205 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad0de85b_22cc_4b43_a8c0_b42fa8f3acf8.slice/crio-1c34a55bccb432856ed07cda38c05bf683922409354cb97b87c2f5ef3fe724a1 WatchSource:0}: Error finding container 1c34a55bccb432856ed07cda38c05bf683922409354cb97b87c2f5ef3fe724a1: Status 404 returned error can't find the container with id 1c34a55bccb432856ed07cda38c05bf683922409354cb97b87c2f5ef3fe724a1 Jun 03 01:00:40.942697 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.942655 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85995bf767-spqpb" event={"ID":"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8","Type":"ContainerStarted","Data":"784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d"} Jun 03 01:00:40.942697 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.942698 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85995bf767-spqpb" event={"ID":"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8","Type":"ContainerStarted","Data":"1c34a55bccb432856ed07cda38c05bf683922409354cb97b87c2f5ef3fe724a1"} Jun 03 01:00:40.957055 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.956992 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-85995bf767-spqpb" podStartSLOduration=1.481516447 podStartE2EDuration="1.956975621s" podCreationTimestamp="2026-06-03 01:00:39 +0000 UTC" firstStartedPulling="2026-06-03 01:00:40.327444216 +0000 UTC m=+696.203377559" lastFinishedPulling="2026-06-03 01:00:40.802903387 +0000 UTC m=+696.678836733" observedRunningTime="2026-06-03 01:00:40.956786903 +0000 UTC m=+696.832720342" watchObservedRunningTime="2026-06-03 01:00:40.956975621 +0000 UTC m=+696.832908988" Jun 03 01:00:40.980377 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.980343 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6677465765-gkq8v"] Jun 03 01:00:40.980725 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:40.980695 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6677465765-gkq8v" podUID="80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" containerName="authorino" containerID="cri-o://4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a" gracePeriod=30 Jun 03 01:00:41.232922 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.232900 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 01:00:41.340275 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.340181 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptv2c\" (UniqueName: \"kubernetes.io/projected/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-kube-api-access-ptv2c\") pod \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " Jun 03 01:00:41.340412 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.340276 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-tls-cert\") pod \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\" (UID: \"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1\") " Jun 03 01:00:41.342494 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.342467 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-kube-api-access-ptv2c" (OuterVolumeSpecName: "kube-api-access-ptv2c") pod "80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" (UID: "80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1"). InnerVolumeSpecName "kube-api-access-ptv2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:00:41.350614 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.350591 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" (UID: "80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:00:41.440937 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.440898 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-tls-cert\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 01:00:41.440937 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.440933 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptv2c\" (UniqueName: \"kubernetes.io/projected/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1-kube-api-access-ptv2c\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 01:00:41.947448 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.947408 2570 generic.go:358] "Generic (PLEG): container finished" podID="80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" containerID="4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a" exitCode=0 Jun 03 01:00:41.947911 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.947460 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6677465765-gkq8v" Jun 03 01:00:41.947911 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.947461 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6677465765-gkq8v" event={"ID":"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1","Type":"ContainerDied","Data":"4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a"} Jun 03 01:00:41.947911 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.947498 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6677465765-gkq8v" event={"ID":"80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1","Type":"ContainerDied","Data":"f8491ac46e78699f43b5c2cf0ee8d05741c185cf39460bf506818d454d831704"} Jun 03 01:00:41.947911 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.947513 2570 scope.go:117] "RemoveContainer" containerID="4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a" Jun 03 01:00:41.956546 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.956501 2570 scope.go:117] "RemoveContainer" containerID="4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a" Jun 03 01:00:41.956782 ip-10-0-140-130 kubenswrapper[2570]: E0603 01:00:41.956764 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a\": container with ID starting with 4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a not found: ID does not exist" containerID="4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a" Jun 03 01:00:41.956837 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.956792 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a"} err="failed to get container status \"4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a\": rpc error: code = NotFound desc = could not find container \"4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a\": container with ID starting with 4803eae8d33aaf9cdce7212ca250737d3822c63b718ecffa3a0d4d2dc3e50e8a not found: ID does not exist" Jun 03 01:00:41.973043 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.973015 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6677465765-gkq8v"] Jun 03 01:00:41.976920 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:41.976895 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6677465765-gkq8v"] Jun 03 01:00:42.656979 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:00:42.656946 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" path="/var/lib/kubelet/pods/80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1/volumes" Jun 03 01:01:04.832305 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.832208 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749"] Jun 03 01:01:04.832929 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.832604 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" containerName="authorino" Jun 03 01:01:04.832929 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.832618 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" containerName="authorino" Jun 03 01:01:04.832929 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.832681 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="80f91ca2-f4fd-4c9d-af04-a0b1ffcbbbb1" containerName="authorino" Jun 03 01:01:04.835747 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.835729 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:04.839580 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.839560 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 01:01:04.839704 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.839611 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 01:01:04.839704 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.839611 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fp5s5\"" Jun 03 01:01:04.839704 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.839617 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 01:01:04.846684 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.846659 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749"] Jun 03 01:01:04.944634 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.944598 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:04.944634 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.944645 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8ll\" (UniqueName: \"kubernetes.io/projected/80b5f7aa-3188-4956-98e1-d895fdcca2b8-kube-api-access-fs8ll\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:04.944888 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.944693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:04.944888 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.944739 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80b5f7aa-3188-4956-98e1-d895fdcca2b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:04.944888 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.944782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:04.944888 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:04.944805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.045543 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045463 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.045543 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045535 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.045809 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045577 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.045809 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045604 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8ll\" (UniqueName: \"kubernetes.io/projected/80b5f7aa-3188-4956-98e1-d895fdcca2b8-kube-api-access-fs8ll\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.045809 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045628 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.045809 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045679 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80b5f7aa-3188-4956-98e1-d895fdcca2b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.046020 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.045982 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.046020 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.046000 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.046091 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.046020 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.048040 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.048020 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80b5f7aa-3188-4956-98e1-d895fdcca2b8-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.048270 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.048253 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80b5f7aa-3188-4956-98e1-d895fdcca2b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.053945 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.053923 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8ll\" (UniqueName: \"kubernetes.io/projected/80b5f7aa-3188-4956-98e1-d895fdcca2b8-kube-api-access-fs8ll\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qs749\" (UID: \"80b5f7aa-3188-4956-98e1-d895fdcca2b8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.148124 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.148073 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:05.280415 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:05.280380 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749"] Jun 03 01:01:05.283633 ip-10-0-140-130 kubenswrapper[2570]: W0603 01:01:05.283590 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b5f7aa_3188_4956_98e1_d895fdcca2b8.slice/crio-804157d4cd60ad14aa2d18f13231941cdceb39235b04671003e22a1a1904a449 WatchSource:0}: Error finding container 804157d4cd60ad14aa2d18f13231941cdceb39235b04671003e22a1a1904a449: Status 404 returned error can't find the container with id 804157d4cd60ad14aa2d18f13231941cdceb39235b04671003e22a1a1904a449 Jun 03 01:01:06.032288 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:06.032251 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" event={"ID":"80b5f7aa-3188-4956-98e1-d895fdcca2b8","Type":"ContainerStarted","Data":"804157d4cd60ad14aa2d18f13231941cdceb39235b04671003e22a1a1904a449"} Jun 03 01:01:10.056240 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:10.056199 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" event={"ID":"80b5f7aa-3188-4956-98e1-d895fdcca2b8","Type":"ContainerStarted","Data":"8ebece82ad5078e0f483e42972df2a9e3bca8c0db7aba767eebd5e944b87416b"} Jun 03 01:01:11.064034 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:11.063996 2570 generic.go:358] "Generic (PLEG): container finished" podID="80b5f7aa-3188-4956-98e1-d895fdcca2b8" containerID="8ebece82ad5078e0f483e42972df2a9e3bca8c0db7aba767eebd5e944b87416b" exitCode=0 Jun 03 01:01:11.064433 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:11.064055 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" event={"ID":"80b5f7aa-3188-4956-98e1-d895fdcca2b8","Type":"ContainerDied","Data":"8ebece82ad5078e0f483e42972df2a9e3bca8c0db7aba767eebd5e944b87416b"} Jun 03 01:01:13.072541 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:13.072477 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" event={"ID":"80b5f7aa-3188-4956-98e1-d895fdcca2b8","Type":"ContainerStarted","Data":"bde17f6eab3f30e8a6adc039f7fe506871b831bf0ab77a4283152101a6f9e6d7"} Jun 03 01:01:13.091770 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:13.091710 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" podStartSLOduration=2.276165772 podStartE2EDuration="9.091694769s" podCreationTimestamp="2026-06-03 01:01:04 +0000 UTC" firstStartedPulling="2026-06-03 01:01:05.28542215 +0000 UTC m=+721.161355494" lastFinishedPulling="2026-06-03 01:01:12.100951142 +0000 UTC m=+727.976884491" observedRunningTime="2026-06-03 01:01:13.090749263 +0000 UTC m=+728.966682629" watchObservedRunningTime="2026-06-03 01:01:13.091694769 +0000 UTC m=+728.967628134" Jun 03 01:01:15.148283 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:15.148247 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:15.148720 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:15.148404 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:15.160979 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:15.160953 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:16.099540 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:16.099492 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qs749" Jun 03 01:01:27.343637 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.343604 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk"] Jun 03 01:01:27.352900 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.352861 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.355570 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.355543 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 01:01:27.355838 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.355817 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk"] Jun 03 01:01:27.454395 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.454358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a46d2038-b698-4e5f-ac68-6d576a97bbcc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.454616 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.454415 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.454616 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.454455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.454616 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.454485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.454616 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.454544 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzgv\" (UniqueName: \"kubernetes.io/projected/a46d2038-b698-4e5f-ac68-6d576a97bbcc-kube-api-access-jgzgv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.454616 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.454594 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.555914 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.555881 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556094 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.555922 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556094 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.555969 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzgv\" (UniqueName: \"kubernetes.io/projected/a46d2038-b698-4e5f-ac68-6d576a97bbcc-kube-api-access-jgzgv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556094 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.556018 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556094 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.556064 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a46d2038-b698-4e5f-ac68-6d576a97bbcc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556281 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.556104 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556335 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.556276 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556396 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.556360 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.556396 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.556389 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.558556 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.558502 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a46d2038-b698-4e5f-ac68-6d576a97bbcc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.558730 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.558713 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a46d2038-b698-4e5f-ac68-6d576a97bbcc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.564970 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.564946 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzgv\" (UniqueName: \"kubernetes.io/projected/a46d2038-b698-4e5f-ac68-6d576a97bbcc-kube-api-access-jgzgv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk\" (UID: \"a46d2038-b698-4e5f-ac68-6d576a97bbcc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.664965 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.664933 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:27.792221 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:27.792192 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk"] Jun 03 01:01:27.795460 ip-10-0-140-130 kubenswrapper[2570]: W0603 01:01:27.795434 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46d2038_b698_4e5f_ac68_6d576a97bbcc.slice/crio-be854fd0fc9d94bb94b6028932f40f63c6749103f02d7268bc7bc67684a8de55 WatchSource:0}: Error finding container be854fd0fc9d94bb94b6028932f40f63c6749103f02d7268bc7bc67684a8de55: Status 404 returned error can't find the container with id be854fd0fc9d94bb94b6028932f40f63c6749103f02d7268bc7bc67684a8de55 Jun 03 01:01:28.130495 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:28.130459 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" event={"ID":"a46d2038-b698-4e5f-ac68-6d576a97bbcc","Type":"ContainerStarted","Data":"9c9b06c00042f20ced6721f8b4471d3303b2c7f804abf2060bd399f1de8586e9"} Jun 03 01:01:28.130495 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:28.130496 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" event={"ID":"a46d2038-b698-4e5f-ac68-6d576a97bbcc","Type":"ContainerStarted","Data":"be854fd0fc9d94bb94b6028932f40f63c6749103f02d7268bc7bc67684a8de55"} Jun 03 01:01:30.138943 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:30.138910 2570 generic.go:358] "Generic (PLEG): container finished" podID="a46d2038-b698-4e5f-ac68-6d576a97bbcc" containerID="9c9b06c00042f20ced6721f8b4471d3303b2c7f804abf2060bd399f1de8586e9" exitCode=0 Jun 03 01:01:30.139321 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:30.138975 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" event={"ID":"a46d2038-b698-4e5f-ac68-6d576a97bbcc","Type":"ContainerDied","Data":"9c9b06c00042f20ced6721f8b4471d3303b2c7f804abf2060bd399f1de8586e9"} Jun 03 01:01:35.159616 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:35.159584 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" event={"ID":"a46d2038-b698-4e5f-ac68-6d576a97bbcc","Type":"ContainerStarted","Data":"2d104337eee5d980ef7d62f2fd2895a04cc73020927ed5592fd83c00e841407d"} Jun 03 01:01:35.179695 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:35.179643 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" podStartSLOduration=3.25394404 podStartE2EDuration="8.1796307s" podCreationTimestamp="2026-06-03 01:01:27 +0000 UTC" firstStartedPulling="2026-06-03 01:01:30.139617281 +0000 UTC m=+746.015550625" lastFinishedPulling="2026-06-03 01:01:35.065303941 +0000 UTC m=+750.941237285" observedRunningTime="2026-06-03 01:01:35.178212725 +0000 UTC m=+751.054146093" watchObservedRunningTime="2026-06-03 01:01:35.1796307 +0000 UTC m=+751.055564066" Jun 03 01:01:37.665803 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:37.665768 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:37.666183 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:37.665826 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:37.678021 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:37.677992 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:01:38.180679 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:01:38.180640 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk" Jun 03 01:02:32.341067 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.341031 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-999c9f9f4-ngdlk"] Jun 03 01:02:32.343291 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.343268 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.351390 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.351363 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-999c9f9f4-ngdlk"] Jun 03 01:02:32.425661 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.425616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e76124-a00c-467d-a1c8-fbc76f4877a9-tls-cert\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.425831 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.425686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e7e76124-a00c-467d-a1c8-fbc76f4877a9-oidc-ca\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.425831 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.425802 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v6ww\" (UniqueName: \"kubernetes.io/projected/e7e76124-a00c-467d-a1c8-fbc76f4877a9-kube-api-access-2v6ww\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.526951 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.526912 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e76124-a00c-467d-a1c8-fbc76f4877a9-tls-cert\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.527124 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.526967 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e7e76124-a00c-467d-a1c8-fbc76f4877a9-oidc-ca\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.527124 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.527021 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2v6ww\" (UniqueName: \"kubernetes.io/projected/e7e76124-a00c-467d-a1c8-fbc76f4877a9-kube-api-access-2v6ww\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.527679 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.527654 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e7e76124-a00c-467d-a1c8-fbc76f4877a9-oidc-ca\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.529431 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.529414 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e76124-a00c-467d-a1c8-fbc76f4877a9-tls-cert\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.534172 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.534155 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v6ww\" (UniqueName: \"kubernetes.io/projected/e7e76124-a00c-467d-a1c8-fbc76f4877a9-kube-api-access-2v6ww\") pod \"authorino-999c9f9f4-ngdlk\" (UID: \"e7e76124-a00c-467d-a1c8-fbc76f4877a9\") " pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.652993 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.652953 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-999c9f9f4-ngdlk" Jun 03 01:02:32.781395 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:32.781332 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-999c9f9f4-ngdlk"] Jun 03 01:02:32.783813 ip-10-0-140-130 kubenswrapper[2570]: W0603 01:02:32.783786 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7e76124_a00c_467d_a1c8_fbc76f4877a9.slice/crio-9f76c75f8989d26fcc6144cf8d8c615abe4a23b2aee785bf02ce68c11906895d WatchSource:0}: Error finding container 9f76c75f8989d26fcc6144cf8d8c615abe4a23b2aee785bf02ce68c11906895d: Status 404 returned error can't find the container with id 9f76c75f8989d26fcc6144cf8d8c615abe4a23b2aee785bf02ce68c11906895d Jun 03 01:02:33.365743 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.365707 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-999c9f9f4-ngdlk" event={"ID":"e7e76124-a00c-467d-a1c8-fbc76f4877a9","Type":"ContainerStarted","Data":"6bde2cd9f65e3e06ff95e8c25fe8ac08570309d0c405476adc8e758af868eaf9"} Jun 03 01:02:33.365743 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.365748 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-999c9f9f4-ngdlk" event={"ID":"e7e76124-a00c-467d-a1c8-fbc76f4877a9","Type":"ContainerStarted","Data":"9f76c75f8989d26fcc6144cf8d8c615abe4a23b2aee785bf02ce68c11906895d"} Jun 03 01:02:33.382221 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.382165 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-999c9f9f4-ngdlk" podStartSLOduration=0.927779951 podStartE2EDuration="1.382138073s" podCreationTimestamp="2026-06-03 01:02:32 +0000 UTC" firstStartedPulling="2026-06-03 01:02:32.785154786 +0000 UTC m=+808.661088146" lastFinishedPulling="2026-06-03 01:02:33.23951291 +0000 UTC m=+809.115446268" observedRunningTime="2026-06-03 01:02:33.380874149 +0000 UTC m=+809.256807516" watchObservedRunningTime="2026-06-03 01:02:33.382138073 +0000 UTC m=+809.258071455" Jun 03 01:02:33.409062 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.409027 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85995bf767-spqpb"] Jun 03 01:02:33.409277 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.409254 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-85995bf767-spqpb" podUID="ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" containerName="authorino" containerID="cri-o://784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d" gracePeriod=30 Jun 03 01:02:33.677976 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.677943 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:02:33.737658 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.737625 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-oidc-ca\") pod \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " Jun 03 01:02:33.737817 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.737690 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt2v9\" (UniqueName: \"kubernetes.io/projected/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-kube-api-access-jt2v9\") pod \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " Jun 03 01:02:33.737817 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.737781 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-tls-cert\") pod \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\" (UID: \"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8\") " Jun 03 01:02:33.739880 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.739851 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-kube-api-access-jt2v9" (OuterVolumeSpecName: "kube-api-access-jt2v9") pod "ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" (UID: "ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8"). InnerVolumeSpecName "kube-api-access-jt2v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:02:33.742611 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.742589 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" (UID: "ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:02:33.750060 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.750031 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" (UID: "ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:02:33.838576 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.838464 2570 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-oidc-ca\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 01:02:33.838576 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.838499 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt2v9\" (UniqueName: \"kubernetes.io/projected/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-kube-api-access-jt2v9\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 01:02:33.838576 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:33.838510 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8-tls-cert\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 01:02:34.369974 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.369933 2570 generic.go:358] "Generic (PLEG): container finished" podID="ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" containerID="784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d" exitCode=0 Jun 03 01:02:34.370396 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.370002 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85995bf767-spqpb" Jun 03 01:02:34.370396 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.370020 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85995bf767-spqpb" event={"ID":"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8","Type":"ContainerDied","Data":"784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d"} Jun 03 01:02:34.370396 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.370061 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85995bf767-spqpb" event={"ID":"ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8","Type":"ContainerDied","Data":"1c34a55bccb432856ed07cda38c05bf683922409354cb97b87c2f5ef3fe724a1"} Jun 03 01:02:34.370396 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.370082 2570 scope.go:117] "RemoveContainer" containerID="784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d" Jun 03 01:02:34.378492 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.378474 2570 scope.go:117] "RemoveContainer" containerID="784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d" Jun 03 01:02:34.378758 ip-10-0-140-130 kubenswrapper[2570]: E0603 01:02:34.378740 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d\": container with ID starting with 784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d not found: ID does not exist" containerID="784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d" Jun 03 01:02:34.378806 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.378767 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d"} err="failed to get container status \"784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d\": rpc error: code = NotFound desc = could not find container \"784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d\": container with ID starting with 784a62cc923687c3132c136c649bea0dba12da314bbb77905ad229182b25ad9d not found: ID does not exist" Jun 03 01:02:34.390784 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.390756 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85995bf767-spqpb"] Jun 03 01:02:34.396512 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.396487 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85995bf767-spqpb"] Jun 03 01:02:34.657321 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:02:34.657238 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" path="/var/lib/kubelet/pods/ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8/volumes" Jun 03 01:04:02.351347 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.351247 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-mkrgg"] Jun 03 01:04:02.351970 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.351581 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" podUID="d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" containerName="manager" containerID="cri-o://a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09" gracePeriod=30 Jun 03 01:04:02.599439 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.599412 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 01:04:02.634570 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.634538 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2ww8\" (UniqueName: \"kubernetes.io/projected/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82-kube-api-access-n2ww8\") pod \"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82\" (UID: \"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82\") " Jun 03 01:04:02.636910 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.636873 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82-kube-api-access-n2ww8" (OuterVolumeSpecName: "kube-api-access-n2ww8") pod "d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" (UID: "d40ef0b4-7c48-4dd4-ad78-cfea10bdda82"). InnerVolumeSpecName "kube-api-access-n2ww8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:04:02.674132 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.674100 2570 generic.go:358] "Generic (PLEG): container finished" podID="d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" containerID="a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09" exitCode=0 Jun 03 01:04:02.674286 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.674157 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" Jun 03 01:04:02.674286 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.674182 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" event={"ID":"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82","Type":"ContainerDied","Data":"a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09"} Jun 03 01:04:02.674286 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.674219 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6bb74d9f-mkrgg" event={"ID":"d40ef0b4-7c48-4dd4-ad78-cfea10bdda82","Type":"ContainerDied","Data":"2dd135cd685a565256582677764647f86bb4af04146f543a59f00f86ca4a31ba"} Jun 03 01:04:02.674286 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.674236 2570 scope.go:117] "RemoveContainer" containerID="a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09" Jun 03 01:04:02.682535 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.682500 2570 scope.go:117] "RemoveContainer" containerID="a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09" Jun 03 01:04:02.682802 ip-10-0-140-130 kubenswrapper[2570]: E0603 01:04:02.682781 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09\": container with ID starting with a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09 not found: ID does not exist" containerID="a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09" Jun 03 01:04:02.682860 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.682811 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09"} err="failed to get container status \"a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09\": rpc error: code = NotFound desc = could not find container \"a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09\": container with ID starting with a29d2ba04a34f5c75f13d799812800d17eee1a8514837440c614ac8621ebba09 not found: ID does not exist" Jun 03 01:04:02.690766 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.690739 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-mkrgg"] Jun 03 01:04:02.695844 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.695821 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-mkrgg"] Jun 03 01:04:02.735364 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:02.735327 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2ww8\" (UniqueName: \"kubernetes.io/projected/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82-kube-api-access-n2ww8\") on node \"ip-10-0-140-130.ec2.internal\" DevicePath \"\"" Jun 03 01:04:03.491729 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.491694 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-ds47j"] Jun 03 01:04:03.492202 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.492181 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" containerName="authorino" Jun 03 01:04:03.492273 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.492207 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" containerName="authorino" Jun 03 01:04:03.492273 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.492227 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" containerName="manager" Jun 03 01:04:03.492273 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.492235 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" containerName="manager" Jun 03 01:04:03.492428 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.492328 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad0de85b-22cc-4b43-a8c0-b42fa8f3acf8" containerName="authorino" Jun 03 01:04:03.492428 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.492344 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" containerName="manager" Jun 03 01:04:03.495057 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.495038 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:04:03.497530 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.497489 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hvggr\"" Jun 03 01:04:03.497642 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.497557 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 01:04:03.501559 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.501533 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-ds47j"] Jun 03 01:04:03.542898 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.542860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjdhm\" (UniqueName: \"kubernetes.io/projected/f2224a19-8e09-4eab-b7af-b7c3fd2673b9-kube-api-access-zjdhm\") pod \"maas-controller-7f6bb74d9f-ds47j\" (UID: \"f2224a19-8e09-4eab-b7af-b7c3fd2673b9\") " pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:04:03.644218 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.644132 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjdhm\" (UniqueName: \"kubernetes.io/projected/f2224a19-8e09-4eab-b7af-b7c3fd2673b9-kube-api-access-zjdhm\") pod \"maas-controller-7f6bb74d9f-ds47j\" (UID: \"f2224a19-8e09-4eab-b7af-b7c3fd2673b9\") " pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:04:03.653785 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.653760 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjdhm\" (UniqueName: \"kubernetes.io/projected/f2224a19-8e09-4eab-b7af-b7c3fd2673b9-kube-api-access-zjdhm\") pod \"maas-controller-7f6bb74d9f-ds47j\" (UID: \"f2224a19-8e09-4eab-b7af-b7c3fd2673b9\") " pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:04:03.805555 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.805503 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:04:03.936722 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:03.936695 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6bb74d9f-ds47j"] Jun 03 01:04:03.939046 ip-10-0-140-130 kubenswrapper[2570]: W0603 01:04:03.939010 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2224a19_8e09_4eab_b7af_b7c3fd2673b9.slice/crio-e4ed8965c497a87c4cd0cf92fcf2f1c2d7d373924856ed477ad24da4d70b781a WatchSource:0}: Error finding container e4ed8965c497a87c4cd0cf92fcf2f1c2d7d373924856ed477ad24da4d70b781a: Status 404 returned error can't find the container with id e4ed8965c497a87c4cd0cf92fcf2f1c2d7d373924856ed477ad24da4d70b781a Jun 03 01:04:04.600246 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:04.600167 2570 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 01:04:04.658951 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:04.658918 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d40ef0b4-7c48-4dd4-ad78-cfea10bdda82" path="/var/lib/kubelet/pods/d40ef0b4-7c48-4dd4-ad78-cfea10bdda82/volumes" Jun 03 01:04:04.683597 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:04.683558 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" event={"ID":"f2224a19-8e09-4eab-b7af-b7c3fd2673b9","Type":"ContainerStarted","Data":"e1f30ff3c454c8e967a67816c85606d04410fab0e9ac2eacb38580e36e27c2ae"} Jun 03 01:04:04.683597 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:04.683599 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" event={"ID":"f2224a19-8e09-4eab-b7af-b7c3fd2673b9","Type":"ContainerStarted","Data":"e4ed8965c497a87c4cd0cf92fcf2f1c2d7d373924856ed477ad24da4d70b781a"} Jun 03 01:04:04.683818 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:04.683685 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:04:04.699748 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:04.699693 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" podStartSLOduration=1.29931444 podStartE2EDuration="1.6996765s" podCreationTimestamp="2026-06-03 01:04:03 +0000 UTC" firstStartedPulling="2026-06-03 01:04:03.940385375 +0000 UTC m=+899.816318722" lastFinishedPulling="2026-06-03 01:04:04.340747434 +0000 UTC m=+900.216680782" observedRunningTime="2026-06-03 01:04:04.698220455 +0000 UTC m=+900.574153822" watchObservedRunningTime="2026-06-03 01:04:04.6996765 +0000 UTC m=+900.575609868" Jun 03 01:04:15.692384 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:04:15.692352 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f6bb74d9f-ds47j" Jun 03 01:07:01.293257 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:01.293152 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-999c9f9f4-ngdlk_e7e76124-a00c-467d-a1c8-fbc76f4877a9/authorino/0.log" Jun 03 01:07:05.887353 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:05.887302 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6995685bb-df85f_964001d6-b2f7-43a3-867f-d04682fb1f3e/nginx/0.log" Jun 03 01:07:06.455858 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:06.455827 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f6bb74d9f-ds47j_f2224a19-8e09-4eab-b7af-b7c3fd2673b9/manager/0.log" Jun 03 01:07:07.019263 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:07.019237 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-f4k4r_a1b76afc-e647-4cd8-99e7-59c2cf5d5c10/copy-manifests/0.log" Jun 03 01:07:07.026047 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:07.026027 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-f4k4r_a1b76afc-e647-4cd8-99e7-59c2cf5d5c10/manager/0.log" Jun 03 01:07:07.131176 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:07.131147 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-zj8nd_3752ae53-2f18-406c-b423-66c7c4c1ebf1/postgres/0.log" Jun 03 01:07:08.375510 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:08.375472 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-999c9f9f4-ngdlk_e7e76124-a00c-467d-a1c8-fbc76f4877a9/authorino/0.log" Jun 03 01:07:08.699848 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:08.699772 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-rjl28_c10a49ce-d30a-4e4b-ad1b-bd91999ab57a/kuadrant-console-plugin/0.log" Jun 03 01:07:08.819586 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:08.819559 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vk4wm_f0b15f3b-e466-46db-8526-5733c9097800/registry-server/0.log" Jun 03 01:07:09.510527 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:09.510497 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf_6b0646a4-fe57-47c2-8b38-215492a455ef/istio-proxy/0.log" Jun 03 01:07:09.964430 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:09.964390 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-zkdnm_1f92e533-6e98-4b5d-bfc3-5973c027411c/istio-proxy/0.log" Jun 03 01:07:10.081760 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:10.081729 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-k4wcw_dc7b82d8-a9a0-4403-9e07-a8fd553c9696/payload-processing/0.log" Jun 03 01:07:10.647881 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:10.647830 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-qs749_80b5f7aa-3188-4956-98e1-d895fdcca2b8/storage-initializer/0.log" Jun 03 01:07:10.658856 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:10.658821 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-qs749_80b5f7aa-3188-4956-98e1-d895fdcca2b8/main/0.log" Jun 03 01:07:10.892310 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:10.892282 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk_a46d2038-b698-4e5f-ac68-6d576a97bbcc/storage-initializer/0.log" Jun 03 01:07:10.902845 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:10.902780 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wrhgk_a46d2038-b698-4e5f-ac68-6d576a97bbcc/main/0.log" Jun 03 01:07:17.934799 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:17.934768 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ckwcv_11c60fe2-574b-4658-b34a-ff2696516757/global-pull-secret-syncer/0.log" Jun 03 01:07:18.188863 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:18.188781 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z6l5m_079fafe0-a32e-47b9-8a5e-2a1e9a1fcd38/konnectivity-agent/0.log" Jun 03 01:07:18.239465 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:18.239435 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-130.ec2.internal_8b44d7c0a6240cf94f6a0c54e589f5d9/haproxy/0.log" Jun 03 01:07:22.464878 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:22.464846 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-999c9f9f4-ngdlk_e7e76124-a00c-467d-a1c8-fbc76f4877a9/authorino/0.log" Jun 03 01:07:22.551890 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:22.551861 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-rjl28_c10a49ce-d30a-4e4b-ad1b-bd91999ab57a/kuadrant-console-plugin/0.log" Jun 03 01:07:22.582399 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:22.582371 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vk4wm_f0b15f3b-e466-46db-8526-5733c9097800/registry-server/0.log" Jun 03 01:07:24.720903 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:24.720865 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6grxj_b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe/node-exporter/0.log" Jun 03 01:07:24.750245 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:24.750215 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6grxj_b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe/kube-rbac-proxy/0.log" Jun 03 01:07:24.768632 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:24.768607 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6grxj_b0b60fc8-4ca9-4d75-b5af-f67b408ce4fe/init-textfile/0.log" Jun 03 01:07:25.395068 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:25.395038 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8879c48-624mw_fc8b9a4c-a52b-438b-9805-b8d26e10dd23/thanos-query/0.log" Jun 03 01:07:25.421627 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:25.421599 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8879c48-624mw_fc8b9a4c-a52b-438b-9805-b8d26e10dd23/kube-rbac-proxy-web/0.log" Jun 03 01:07:25.443894 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:25.443868 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8879c48-624mw_fc8b9a4c-a52b-438b-9805-b8d26e10dd23/kube-rbac-proxy/0.log" Jun 03 01:07:25.466314 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:25.466288 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8879c48-624mw_fc8b9a4c-a52b-438b-9805-b8d26e10dd23/prom-label-proxy/0.log" Jun 03 01:07:25.492035 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:25.492009 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8879c48-624mw_fc8b9a4c-a52b-438b-9805-b8d26e10dd23/kube-rbac-proxy-rules/0.log" Jun 03 01:07:25.515432 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:25.515402 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8879c48-624mw_fc8b9a4c-a52b-438b-9805-b8d26e10dd23/kube-rbac-proxy-metrics/0.log" Jun 03 01:07:26.992155 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:26.992121 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66"] Jun 03 01:07:26.995907 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:26.995874 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:26.999256 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:26.999227 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wc94h\"/\"kube-root-ca.crt\"" Jun 03 01:07:27.000544 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.000472 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wc94h\"/\"default-dockercfg-xxpt9\"" Jun 03 01:07:27.000698 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.000606 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wc94h\"/\"openshift-service-ca.crt\"" Jun 03 01:07:27.003738 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.003700 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66"] Jun 03 01:07:27.119877 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.119842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-proc\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.120059 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.119912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-sys\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.120059 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.119973 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98bb\" (UniqueName: \"kubernetes.io/projected/ac8cd397-d475-4113-a52a-9bbc143ccd67-kube-api-access-g98bb\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.120059 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.120003 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-lib-modules\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.120059 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.120022 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-podres\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221169 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221128 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-sys\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221349 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221204 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g98bb\" (UniqueName: \"kubernetes.io/projected/ac8cd397-d475-4113-a52a-9bbc143ccd67-kube-api-access-g98bb\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221349 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221229 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-lib-modules\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221349 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221254 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-podres\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221349 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221255 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-sys\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221349 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221295 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-proc\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221566 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221386 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-lib-modules\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221566 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221397 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-proc\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.221566 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.221398 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac8cd397-d475-4113-a52a-9bbc143ccd67-podres\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.229442 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.229416 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98bb\" (UniqueName: \"kubernetes.io/projected/ac8cd397-d475-4113-a52a-9bbc143ccd67-kube-api-access-g98bb\") pod \"perf-node-gather-daemonset-2lv66\" (UID: \"ac8cd397-d475-4113-a52a-9bbc143ccd67\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.308656 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.308561 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:27.438098 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.438065 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66"] Jun 03 01:07:27.440834 ip-10-0-140-130 kubenswrapper[2570]: W0603 01:07:27.440804 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac8cd397_d475_4113_a52a_9bbc143ccd67.slice/crio-3723881e7203c248ffc14717dcc801c73a84521f9eb96cdd58cbebcc69af5bc5 WatchSource:0}: Error finding container 3723881e7203c248ffc14717dcc801c73a84521f9eb96cdd58cbebcc69af5bc5: Status 404 returned error can't find the container with id 3723881e7203c248ffc14717dcc801c73a84521f9eb96cdd58cbebcc69af5bc5 Jun 03 01:07:27.442416 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.442402 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:07:27.618453 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:27.618417 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5675b64db6-96htw_b809f305-582a-4374-aa68-e43f29415a57/console/0.log" Jun 03 01:07:28.391790 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:28.391760 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" event={"ID":"ac8cd397-d475-4113-a52a-9bbc143ccd67","Type":"ContainerStarted","Data":"4c46ae73fcfa2b71eaa5bcd90f8a5a28ec6acda6c47717309bb6ce22f4caa887"} Jun 03 01:07:28.391790 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:28.391794 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" event={"ID":"ac8cd397-d475-4113-a52a-9bbc143ccd67","Type":"ContainerStarted","Data":"3723881e7203c248ffc14717dcc801c73a84521f9eb96cdd58cbebcc69af5bc5"} Jun 03 01:07:28.392223 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:28.391818 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:28.408265 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:28.408210 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" podStartSLOduration=2.408194701 podStartE2EDuration="2.408194701s" podCreationTimestamp="2026-06-03 01:07:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:07:28.406728583 +0000 UTC m=+1104.282661948" watchObservedRunningTime="2026-06-03 01:07:28.408194701 +0000 UTC m=+1104.284128115" Jun 03 01:07:28.866270 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:28.866244 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4gqbs_2efe21ed-376a-4b69-8b1d-2ce240a24c20/dns/0.log" Jun 03 01:07:28.887781 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:28.887753 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4gqbs_2efe21ed-376a-4b69-8b1d-2ce240a24c20/kube-rbac-proxy/0.log" Jun 03 01:07:29.017762 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:29.017734 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8xzmp_de330ce3-917a-4067-8725-3c256db3aea1/dns-node-resolver/0.log" Jun 03 01:07:29.574434 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:29.574401 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l9k2p_0b2a1d08-ecd8-45d7-b5cd-ba036996b8b5/node-ca/0.log" Jun 03 01:07:30.377925 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:30.377890 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bb9zrf_6b0646a4-fe57-47c2-8b38-215492a455ef/istio-proxy/0.log" Jun 03 01:07:30.501403 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:30.501370 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-zkdnm_1f92e533-6e98-4b5d-bfc3-5973c027411c/istio-proxy/0.log" Jun 03 01:07:30.533632 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:30.533594 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-k4wcw_dc7b82d8-a9a0-4403-9e07-a8fd553c9696/payload-processing/0.log" Jun 03 01:07:31.065033 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:31.064987 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p2s5p_03ac9623-ed75-4cf3-a0f8-87cb3a8a5892/serve-healthcheck-canary/0.log" Jun 03 01:07:31.585274 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:31.585241 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjwc4_ee7a80ff-428c-4cd5-835b-caa8149a5931/kube-rbac-proxy/0.log" Jun 03 01:07:31.608941 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:31.608912 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjwc4_ee7a80ff-428c-4cd5-835b-caa8149a5931/exporter/0.log" Jun 03 01:07:31.630336 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:31.630307 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjwc4_ee7a80ff-428c-4cd5-835b-caa8149a5931/extractor/0.log" Jun 03 01:07:33.625271 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:33.625241 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6995685bb-df85f_964001d6-b2f7-43a3-867f-d04682fb1f3e/nginx/0.log" Jun 03 01:07:33.766863 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:33.766832 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f6bb74d9f-ds47j_f2224a19-8e09-4eab-b7af-b7c3fd2673b9/manager/0.log" Jun 03 01:07:33.987409 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:33.987324 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-f4k4r_a1b76afc-e647-4cd8-99e7-59c2cf5d5c10/manager/0.log" Jun 03 01:07:34.006778 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:34.006754 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-f4k4r_a1b76afc-e647-4cd8-99e7-59c2cf5d5c10/copy-manifests/0.log" Jun 03 01:07:34.030429 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:34.030400 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-zj8nd_3752ae53-2f18-406c-b423-66c7c4c1ebf1/postgres/0.log" Jun 03 01:07:34.406594 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:34.406570 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-2lv66" Jun 03 01:07:35.341962 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:35.341932 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8474b9f56-bmhh7_243afe83-a497-4a13-b233-2a7d67753572/manager/0.log" Jun 03 01:07:41.344219 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.344184 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2gx8d_476605e9-d423-4615-b992-89fe786010c7/kube-multus/0.log" Jun 03 01:07:41.366410 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.366385 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/kube-multus-additional-cni-plugins/0.log" Jun 03 01:07:41.388283 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.388260 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/egress-router-binary-copy/0.log" Jun 03 01:07:41.410762 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.410738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/cni-plugins/0.log" Jun 03 01:07:41.432725 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.432678 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/bond-cni-plugin/0.log" Jun 03 01:07:41.452794 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.452771 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/routeoverride-cni/0.log" Jun 03 01:07:41.476336 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.476315 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/whereabouts-cni-bincopy/0.log" Jun 03 01:07:41.499569 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.499541 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n4fh_c962202c-84d1-454a-9a66-39775fcfb016/whereabouts-cni/0.log" Jun 03 01:07:41.971250 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.971222 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nrlbr_ee87d98c-44ad-43c2-8509-1d4087086c3f/network-metrics-daemon/0.log" Jun 03 01:07:41.990297 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:41.990271 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nrlbr_ee87d98c-44ad-43c2-8509-1d4087086c3f/kube-rbac-proxy/0.log" Jun 03 01:07:43.074398 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.074316 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/ovn-controller/0.log" Jun 03 01:07:43.099599 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.099570 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/ovn-acl-logging/0.log" Jun 03 01:07:43.117164 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.117137 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/kube-rbac-proxy-node/0.log" Jun 03 01:07:43.139417 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.139390 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 01:07:43.160450 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.160422 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/northd/0.log" Jun 03 01:07:43.180441 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.180416 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/nbdb/0.log" Jun 03 01:07:43.201901 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.201877 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/sbdb/0.log" Jun 03 01:07:43.296257 ip-10-0-140-130 kubenswrapper[2570]: I0603 01:07:43.296225 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjjfg_a78fe96a-caf8-4817-8a6c-0bbf324e0e5b/ovnkube-controller/0.log"