Jun 02 15:21:07.336867 ip-10-0-140-163 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 15:21:07.336876 ip-10-0-140-163 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 15:21:07.336883 ip-10-0-140-163 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 15:21:07.337102 ip-10-0-140-163 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 15:21:17.586125 ip-10-0-140-163 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 15:21:17.586140 ip-10-0-140-163 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f7e5274786df4ae8acf12c704e6b6fdf -- Jun 02 15:23:34.829645 ip-10-0-140-163 systemd[1]: Starting Kubernetes Kubelet... Jun 02 15:23:35.244249 ip-10-0-140-163 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:35.244249 ip-10-0-140-163 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 15:23:35.244249 ip-10-0-140-163 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:35.244249 ip-10-0-140-163 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 15:23:35.244249 ip-10-0-140-163 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:35.247053 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.246967 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 15:23:35.249822 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249806 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:35.249822 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249821 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249828 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249831 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249834 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249837 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249840 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249843 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249845 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249848 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249851 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249853 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249856 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249859 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249861 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249863 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249866 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249869 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249871 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249878 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249881 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:35.249883 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249885 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249890 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249893 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249896 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249898 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249901 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249903 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249906 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249908 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249911 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249913 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249916 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249919 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249921 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249924 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249926 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249929 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249932 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249934 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249937 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:35.250371 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249939 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249949 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249951 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249954 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249957 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249959 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249962 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249964 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249967 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249970 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249972 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249975 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249977 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249979 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249983 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249985 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249988 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249990 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249993 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249996 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:35.250853 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.249999 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250001 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250004 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250008 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250011 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250014 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250016 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250019 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250021 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250024 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250026 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250029 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250031 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250034 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250036 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250041 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250044 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250047 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250050 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:35.251326 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250053 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250056 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250059 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250061 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250064 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250066 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250484 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250491 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250494 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250497 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250500 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250503 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250507 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250510 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250512 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250515 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250519 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250521 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250524 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250526 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:35.251812 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250529 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250531 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250534 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250536 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250539 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250541 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250544 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250546 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250549 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250551 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250554 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250557 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250559 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250562 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250564 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250567 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250569 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250572 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250574 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250578 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:35.252284 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250581 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250584 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250586 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250589 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250591 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250594 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250596 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250599 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250601 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250604 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250607 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250609 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250612 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250614 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250617 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250619 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250621 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250626 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250629 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250631 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:35.252826 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250634 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250636 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250639 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250642 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250644 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250646 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250649 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250652 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250655 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250657 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250660 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250663 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250665 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250668 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250671 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250674 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250676 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250678 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250681 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250683 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:35.253314 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250686 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250690 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250694 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250696 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250699 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250702 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250705 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250707 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250710 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250713 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250716 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.250718 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251530 2555 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251540 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251547 2555 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251552 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251556 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251559 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251564 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251576 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 15:23:35.253819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251581 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251584 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251589 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251592 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251595 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251598 2555 flags.go:64] FLAG: --cgroup-root="" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251601 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251604 2555 flags.go:64] FLAG: --client-ca-file="" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251607 2555 flags.go:64] FLAG: --cloud-config="" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251610 2555 flags.go:64] FLAG: --cloud-provider="external" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251613 2555 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251617 2555 flags.go:64] FLAG: --cluster-domain="" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251620 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251623 2555 flags.go:64] FLAG: --config-dir="" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251626 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251630 2555 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251634 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251637 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251640 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251644 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251647 2555 flags.go:64] FLAG: --contention-profiling="false" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251650 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251653 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251656 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251659 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 15:23:35.254317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251663 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251666 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251669 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251672 2555 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251675 2555 flags.go:64] FLAG: --enable-server="true" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251678 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251683 2555 flags.go:64] FLAG: --event-burst="100" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251686 2555 flags.go:64] FLAG: --event-qps="50" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251688 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251691 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251694 2555 flags.go:64] FLAG: --eviction-hard="" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251698 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251701 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251704 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251707 2555 flags.go:64] FLAG: --eviction-soft="" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251710 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251713 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251716 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251719 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251722 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251725 2555 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251727 2555 flags.go:64] FLAG: --feature-gates="" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251731 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251735 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251738 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 15:23:35.254935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251741 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251749 2555 flags.go:64] FLAG: --healthz-port="10248" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251753 2555 flags.go:64] FLAG: --help="false" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251756 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251759 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251762 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251765 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251768 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251772 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251775 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251777 2555 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251780 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251784 2555 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251786 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251789 2555 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251792 2555 flags.go:64] FLAG: --kube-reserved="" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251795 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251798 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251801 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251804 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251806 2555 flags.go:64] FLAG: --lock-file="" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251809 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251812 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251815 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 15:23:35.255583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251821 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251824 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251826 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251829 2555 flags.go:64] FLAG: --logging-format="text" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251832 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251836 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251838 2555 flags.go:64] FLAG: --manifest-url="" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251842 2555 flags.go:64] FLAG: --manifest-url-header="" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251846 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251851 2555 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251856 2555 flags.go:64] FLAG: --max-pods="110" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251859 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251862 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251865 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251868 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251871 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251874 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251877 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251884 2555 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251887 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251890 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251893 2555 flags.go:64] FLAG: --pod-cidr="" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251896 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 15:23:35.256186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251901 2555 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251904 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251908 2555 flags.go:64] FLAG: --pods-per-core="0" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251910 2555 flags.go:64] FLAG: --port="10250" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251913 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251916 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-098bd0a9c917cb115" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251919 2555 flags.go:64] FLAG: --qos-reserved="" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251922 2555 flags.go:64] FLAG: --read-only-port="10255" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251925 2555 flags.go:64] FLAG: --register-node="true" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251928 2555 flags.go:64] FLAG: --register-schedulable="true" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251931 2555 flags.go:64] FLAG: --register-with-taints="" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251934 2555 flags.go:64] FLAG: --registry-burst="10" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251937 2555 flags.go:64] FLAG: --registry-qps="5" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251940 2555 flags.go:64] FLAG: --reserved-cpus="" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251943 2555 flags.go:64] FLAG: --reserved-memory="" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251947 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251950 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251955 2555 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251958 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251963 2555 flags.go:64] FLAG: --runonce="false" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251965 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251968 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251971 2555 flags.go:64] FLAG: --seccomp-default="false" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251974 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251977 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251980 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 15:23:35.256757 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251983 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251986 2555 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251989 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251992 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251995 2555 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.251998 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252000 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252003 2555 flags.go:64] FLAG: --system-cgroups="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252006 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252011 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252014 2555 flags.go:64] FLAG: --tls-cert-file="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252017 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252021 2555 flags.go:64] FLAG: --tls-min-version="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252024 2555 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252027 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252029 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252032 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252035 2555 flags.go:64] FLAG: --v="2" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252040 2555 flags.go:64] FLAG: --version="false" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252044 2555 flags.go:64] FLAG: --vmodule="" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252048 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252051 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252147 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252152 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:35.257407 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252155 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252159 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252162 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252165 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252168 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252171 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252173 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252176 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252178 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252181 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252184 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252187 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252189 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252192 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252195 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252197 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252200 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252203 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252205 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252208 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:35.258449 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252210 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252213 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252215 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252218 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252220 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252223 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252225 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252228 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252230 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252233 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252235 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252239 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252242 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252246 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252249 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252252 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252256 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252259 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252263 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:35.258968 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252265 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252268 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252271 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252273 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252276 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252278 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252281 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252285 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252288 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252291 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252294 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252298 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252301 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252304 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252307 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252309 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252312 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252315 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252318 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:35.259544 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252321 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252323 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252326 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252329 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252331 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252338 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252340 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252355 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252358 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252361 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252363 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252366 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252369 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252371 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252374 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252377 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252379 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252382 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252384 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252387 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:35.260005 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252390 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:35.260711 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252392 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:35.260711 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252395 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:35.260711 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252397 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:35.260711 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252400 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:35.260711 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.252402 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:35.260711 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.252932 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:35.261914 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.261791 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 15:23:35.261914 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.261914 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262021 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262030 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262036 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262041 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262046 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262050 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262055 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262059 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262064 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262068 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:35.262072 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262072 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262085 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262090 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262095 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262099 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262103 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262107 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262111 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262115 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262119 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262124 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262129 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262133 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262137 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262141 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262145 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262151 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262155 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262159 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262163 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:35.262689 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262168 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262172 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262176 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262180 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262184 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262188 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262192 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262196 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262200 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262204 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262208 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262212 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262216 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262220 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262236 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262243 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262250 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262256 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262262 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:35.263491 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262266 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262271 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262276 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262280 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262284 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262289 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262293 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262297 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262301 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262305 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262309 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262313 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262317 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262320 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262325 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262329 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262333 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262338 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262342 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262363 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:35.264034 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262367 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262371 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262375 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262378 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262382 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262386 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262389 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262394 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262406 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262410 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262414 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262417 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262421 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262425 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262428 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262432 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:35.264756 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262436 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.262443 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262640 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262648 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262653 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262659 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262663 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262669 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262675 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262679 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262684 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262688 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262692 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262697 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262701 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:35.265460 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262705 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262709 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262713 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262720 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262725 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262730 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262735 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262740 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262745 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262755 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262767 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262772 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262776 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262780 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262784 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262788 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262792 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262796 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262800 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:35.266053 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262804 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262816 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262821 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262825 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262829 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262833 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262837 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262841 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262845 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262849 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262853 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262857 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262861 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262865 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262869 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262873 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262877 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262881 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262886 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262890 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:35.266782 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262894 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262898 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262903 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262907 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262921 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262925 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262930 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262934 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262937 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262941 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262945 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262949 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262954 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262958 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262962 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262967 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262971 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262975 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262979 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262983 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:35.267586 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262987 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262991 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262995 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.262999 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263003 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263007 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263011 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263015 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263019 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263023 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263027 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263031 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263035 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:35.263039 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.263048 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:35.268079 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.263736 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 15:23:35.268753 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.268734 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 15:23:35.269893 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.269881 2555 server.go:1019] "Starting client certificate rotation" Jun 02 15:23:35.269995 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.269979 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:23:35.270627 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.270616 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:23:35.290603 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.290584 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:23:35.292226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.292211 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:23:35.304841 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.304821 2555 log.go:25] "Validated CRI v1 runtime API" Jun 02 15:23:35.310886 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.310868 2555 log.go:25] "Validated CRI v1 image API" Jun 02 15:23:35.312112 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.312089 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 15:23:35.314385 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.314363 2555 fs.go:135] Filesystem UUIDs: map[0f4231b1-2eb4-402c-8064-49ad98a80828:/dev/nvme0n1p4 2ee63b1e-c412-41ce-aabd-9a1b9b4bd2d5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 02 15:23:35.314457 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.314384 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 15:23:35.319114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.319001 2555 manager.go:217] Machine: {Timestamp:2026-06-02 15:23:35.318519598 +0000 UTC m=+0.376689935 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100305 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f9aade6458991b1b90ab35df8ead1 SystemUUID:ec2f9aad-e645-8991-b1b9-0ab35df8ead1 BootID:f7e52747-86df-4ae8-acf1-2c704e6b6fdf Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:31:3e:08:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:31:3e:08:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:17:df:7a:ce:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 15:23:35.319217 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.319133 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 15:23:35.319267 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.319251 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 15:23:35.321271 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.321240 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 15:23:35.321453 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.321273 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 15:23:35.321543 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.321468 2555 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 15:23:35.321543 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.321482 2555 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 15:23:35.321543 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.321493 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:23:35.321543 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.321515 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:23:35.323252 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.323233 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:23:35.323406 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.323396 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 15:23:35.325517 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.325506 2555 kubelet.go:491] "Attempting to sync node with API server" Jun 02 15:23:35.325562 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.325528 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 15:23:35.326130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.326120 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 15:23:35.326162 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.326136 2555 kubelet.go:397] "Adding apiserver pod source" Jun 02 15:23:35.326162 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.326145 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 15:23:35.329089 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.329061 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:23:35.329194 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.329098 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:23:35.329731 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.329435 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:23:35.332568 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.332549 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 15:23:35.334198 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.334182 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 15:23:35.335993 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.335977 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.335999 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336008 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336015 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336026 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336035 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336044 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336054 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336064 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 15:23:35.336077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336074 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 15:23:35.336460 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336087 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 15:23:35.336460 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336095 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 15:23:35.336460 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336129 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 15:23:35.336460 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.336138 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 15:23:35.339465 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.339449 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 15:23:35.339539 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.339486 2555 server.go:1295] "Started kubelet" Jun 02 15:23:35.339669 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.339617 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 15:23:35.339711 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.339695 2555 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 15:23:35.339945 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.339923 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 15:23:35.340395 ip-10-0-140-163 systemd[1]: Started Kubernetes Kubelet. Jun 02 15:23:35.340623 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.340606 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 15:23:35.341104 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.341087 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 15:23:35.341485 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.341461 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:23:35.341571 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.341510 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 15:23:35.342379 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.342339 2555 server.go:317] "Adding debug handlers to kubelet server" Jun 02 15:23:35.345116 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345097 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 15:23:35.345216 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345139 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 15:23:35.345216 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345203 2555 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 15:23:35.345216 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345213 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 15:23:35.345422 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345408 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 15:23:35.345528 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345516 2555 reconstruct.go:97] "Volume reconstruction finished" Jun 02 15:23:35.345611 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.345602 2555 reconciler.go:26] "Reconciler: start to sync state" Jun 02 15:23:35.346313 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.346289 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.347210 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347185 2555 factory.go:153] Registering CRI-O factory Jun 02 15:23:35.347210 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347212 2555 factory.go:223] Registration of the crio container factory successfully Jun 02 15:23:35.347372 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347267 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 15:23:35.347372 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.347266 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 15:23:35.347372 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347277 2555 factory.go:55] Registering systemd factory Jun 02 15:23:35.347372 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347298 2555 factory.go:223] Registration of the systemd container factory successfully Jun 02 15:23:35.347372 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347326 2555 factory.go:103] Registering Raw factory Jun 02 15:23:35.347372 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347340 2555 manager.go:1196] Started watching for new ooms in manager Jun 02 15:23:35.347858 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.347843 2555 manager.go:319] Starting recovery of all containers Jun 02 15:23:35.348658 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.348636 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 15:23:35.348793 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.348776 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 15:23:35.349464 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.348643 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18b54cee9881aeb8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-06-02 15:23:35.339462328 +0000 UTC m=+0.397632646,LastTimestamp:2026-06-02 15:23:35.339462328 +0000 UTC m=+0.397632646,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jun 02 15:23:35.357450 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.357390 2555 manager.go:324] Recovery completed Jun 02 15:23:35.363021 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.363008 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:35.364889 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.364871 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:35.364950 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.364905 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:35.364950 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.364918 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:35.365514 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.365403 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 15:23:35.365514 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.365416 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 15:23:35.365514 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.365435 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:23:35.366623 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.366556 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18b54cee9a05af66 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-06-02 15:23:35.36489047 +0000 UTC m=+0.423060787,LastTimestamp:2026-06-02 15:23:35.36489047 +0000 UTC m=+0.423060787,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jun 02 15:23:35.367317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.367304 2555 policy_none.go:49] "None policy: Start" Jun 02 15:23:35.367398 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.367326 2555 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 15:23:35.367398 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.367341 2555 state_mem.go:35] "Initializing new in-memory state store" Jun 02 15:23:35.377153 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.377135 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mmdl4" Jun 02 15:23:35.377845 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.377774 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18b54cee9a06040f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-06-02 15:23:35.364912143 +0000 UTC m=+0.423082460,LastTimestamp:2026-06-02 15:23:35.364912143 +0000 UTC m=+0.423082460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jun 02 15:23:35.384748 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.384684 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18b54cee9a062a34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-06-02 15:23:35.364921908 +0000 UTC m=+0.423092225,LastTimestamp:2026-06-02 15:23:35.364921908 +0000 UTC m=+0.423092225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jun 02 15:23:35.386539 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.386514 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mmdl4" Jun 02 15:23:35.410986 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.410971 2555 manager.go:341] "Starting Device Plugin manager" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.411027 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.411038 2555 server.go:85] "Starting device plugin registration server" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.411305 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.411315 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.411425 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.411503 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.411511 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.412334 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 15:23:35.420335 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.412394 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.481900 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.481850 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 15:23:35.483093 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.483076 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 15:23:35.483159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.483099 2555 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 15:23:35.483159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.483122 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 15:23:35.483159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.483129 2555 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 15:23:35.483285 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.483216 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 15:23:35.486099 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.486082 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:35.511585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.511519 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:35.512457 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.512441 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:35.512551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.512472 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:35.512551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.512483 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:35.512551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.512506 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.522267 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.522248 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.522319 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.522271 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-163.ec2.internal\": node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.534569 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.534548 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.584241 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.584205 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal"] Jun 02 15:23:35.584320 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.584289 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:35.585731 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.585717 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:35.585792 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.585746 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:35.585792 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.585756 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:35.586804 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.586790 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:35.586925 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.586906 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.587027 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.586936 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:35.587553 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.587534 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:35.587649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.587553 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:35.587649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.587567 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:35.587649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.587583 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:35.587649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.587589 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:35.587649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.587597 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:35.588543 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.588528 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.588597 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.588559 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:35.589231 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.589217 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:35.589311 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.589253 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:35.589311 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.589268 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:35.614966 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.614948 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-163.ec2.internal\" not found" node="ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.619340 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.619322 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-163.ec2.internal\" not found" node="ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.635239 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.635217 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.647532 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.647497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fb5d6b57d05baaccb153cf6066385d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-163.ec2.internal\" (UID: \"d8fb5d6b57d05baaccb153cf6066385d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.647532 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.647537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36129781e8a462dc5fcfc447b4f88f8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"36129781e8a462dc5fcfc447b4f88f8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.647674 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.647558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36129781e8a462dc5fcfc447b4f88f8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"36129781e8a462dc5fcfc447b4f88f8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.735892 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.735858 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.747967 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.747938 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36129781e8a462dc5fcfc447b4f88f8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"36129781e8a462dc5fcfc447b4f88f8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.748090 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.747975 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36129781e8a462dc5fcfc447b4f88f8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"36129781e8a462dc5fcfc447b4f88f8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.748090 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.747994 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fb5d6b57d05baaccb153cf6066385d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-163.ec2.internal\" (UID: \"d8fb5d6b57d05baaccb153cf6066385d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.748090 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.748039 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36129781e8a462dc5fcfc447b4f88f8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"36129781e8a462dc5fcfc447b4f88f8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.748193 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.748092 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fb5d6b57d05baaccb153cf6066385d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-163.ec2.internal\" (UID: \"d8fb5d6b57d05baaccb153cf6066385d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.748193 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.748125 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36129781e8a462dc5fcfc447b4f88f8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"36129781e8a462dc5fcfc447b4f88f8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.836393 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.836364 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:35.916827 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.916801 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.922249 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:35.922226 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jun 02 15:23:35.936701 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:35.936670 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.037213 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:36.037170 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.137712 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:36.137628 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.238266 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:36.238229 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.269739 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.269691 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 15:23:36.270431 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.269865 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:23:36.339338 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:36.339303 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.345565 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.345549 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 15:23:36.363326 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.363295 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:23:36.388388 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.388304 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 15:18:35 +0000 UTC" deadline="2028-02-18 20:27:37.102362632 +0000 UTC" Jun 02 15:23:36.388388 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.388335 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15029h4m0.714030873s" Jun 02 15:23:36.439666 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:36.439635 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.469846 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.469815 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfg4f" Jun 02 15:23:36.479081 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.479061 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfg4f" Jun 02 15:23:36.507327 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:36.507289 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36129781e8a462dc5fcfc447b4f88f8a.slice/crio-e6df1ea5f13336f9e9bc9a18ff2445589f8f4160314390d6607eae21f7429c5a WatchSource:0}: Error finding container e6df1ea5f13336f9e9bc9a18ff2445589f8f4160314390d6607eae21f7429c5a: Status 404 returned error can't find the container with id e6df1ea5f13336f9e9bc9a18ff2445589f8f4160314390d6607eae21f7429c5a Jun 02 15:23:36.507696 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:36.507678 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fb5d6b57d05baaccb153cf6066385d.slice/crio-a764fcbab0e270691a1e8b762fd852aa092cb0de153b515fa35eb4f49e23ffcc WatchSource:0}: Error finding container a764fcbab0e270691a1e8b762fd852aa092cb0de153b515fa35eb4f49e23ffcc: Status 404 returned error can't find the container with id a764fcbab0e270691a1e8b762fd852aa092cb0de153b515fa35eb4f49e23ffcc Jun 02 15:23:36.510969 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.510955 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:23:36.540585 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:36.540556 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jun 02 15:23:36.569297 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.569150 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:36.603123 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.603099 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:36.646446 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.646383 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jun 02 15:23:36.674642 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.674620 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:23:36.676135 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.676122 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jun 02 15:23:36.682019 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.682000 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:36.690501 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:36.690486 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:23:37.094922 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.094902 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:37.327922 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.327891 2555 apiserver.go:52] "Watching apiserver" Jun 02 15:23:37.338198 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.338167 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 15:23:37.338656 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.338631 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal","openshift-multus/multus-bk74b","openshift-ovn-kubernetes/ovnkube-node-spfzb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz","openshift-image-registry/node-ca-gsk6p","openshift-multus/multus-additional-cni-plugins-vjlst","openshift-multus/network-metrics-daemon-bzvdk","openshift-network-diagnostics/network-check-target-xdx58","openshift-network-operator/iptables-alerter-cm9s8","kube-system/konnectivity-agent-wz9wd","kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bzzs6","openshift-dns/node-resolver-25mpd"] Jun 02 15:23:37.340494 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.340457 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.340604 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.340547 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:37.341427 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.341406 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.342490 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.342464 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.343545 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.343522 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.344455 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.344438 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.345606 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.345534 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.346161 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.346117 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 15:23:37.346161 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.346129 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 15:23:37.346161 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.346149 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bz98q\"" Jun 02 15:23:37.346376 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.346238 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.346676 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.346657 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:37.346772 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.346722 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:37.347786 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.347763 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.348920 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.348877 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.350512 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.350271 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 15:23:37.350590 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.350563 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.350590 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.350572 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.351168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.350806 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.351168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.350981 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 15:23:37.351168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.351060 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 15:23:37.351168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.351067 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 15:23:37.351168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.351082 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 15:23:37.351168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.351089 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.351714 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.351697 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.352058 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.352037 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.352146 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.352116 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 15:23:37.352200 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.352146 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.352250 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.352234 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.352425 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.352383 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.353041 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.352922 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.353686 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zlk47\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.353706 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6rr5r\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.353817 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.353823 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sw44v\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.354041 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.354100 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.354912 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lh2bj\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.354979 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-htrx7\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.355005 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.355995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-cni-netd\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356076 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-system-cni-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356122 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-run-netns\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-ovn\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v444\" (UniqueName: \"kubernetes.io/projected/4ef844ab-b52b-4d24-b468-d86504f8baee-kube-api-access-7v444\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-socket-dir-parent\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356424 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-cni-multus\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356465 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-kubelet\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-systemd-units\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.356828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjltj\" (UniqueName: \"kubernetes.io/projected/e63cd3b2-0087-4fe8-91cc-3cae773f6355-kube-api-access-wjltj\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-os-release\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356607 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-kubelet\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krgzm\" (UniqueName: \"kubernetes.io/projected/372a1cfa-9b38-46b3-a54a-979f6903a961-kube-api-access-krgzm\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfc25338-688b-4fa6-8c24-336aae6fdc53-host\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356725 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-node-log\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-etc-selinux\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356881 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jrwn\" (UniqueName: \"kubernetes.io/projected/dfc25338-688b-4fa6-8c24-336aae6fdc53-kube-api-access-8jrwn\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.356957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffxm9\" (UniqueName: \"kubernetes.io/projected/092e0688-c9d4-4abf-aa2e-f41656eca37d-kube-api-access-ffxm9\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357028 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-multus-certs\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-conf-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-cni-bin\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-env-overrides\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-cnibin\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.357742 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbs7z\" (UniqueName: \"kubernetes.io/projected/e73e771e-49c0-488f-b43c-04ee31f13507-kube-api-access-pbs7z\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-kubelet-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357368 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357413 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-os-release\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-system-cni-dir\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e73e771e-49c0-488f-b43c-04ee31f13507-cni-binary-copy\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-netns\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-cni-bin\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-etc-kubernetes\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.357986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovnkube-config\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovn-node-metrics-cert\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-socket-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-device-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.358441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-etc-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovnkube-script-lib\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-cnibin\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-k8s-cni-cncf-io\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-hostroot\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-slash\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358398 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-systemd\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e73e771e-49c0-488f-b43c-04ee31f13507-multus-daemon-config\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-log-socket\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-registration-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358557 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-sys-fs\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dfc25338-688b-4fa6-8c24-336aae6fdc53-serviceca\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-cni-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-var-lib-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.359168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.358715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-run-ovn-kubernetes\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.360008 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.359943 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.360080 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.360018 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 15:23:37.360080 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.360038 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:23:37.360906 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.360886 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wbvgz\"" Jun 02 15:23:37.360999 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.360909 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.360999 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.360951 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rm728\"" Jun 02 15:23:37.360999 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.360976 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 15:23:37.361167 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.361054 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 15:23:37.361167 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.361115 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8f7hx\"" Jun 02 15:23:37.446306 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.446277 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 15:23:37.459170 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459144 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-iptables-alerter-script\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.459373 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459186 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v546m\" (UniqueName: \"kubernetes.io/projected/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-kube-api-access-v546m\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.459373 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459260 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459373 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459337 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459506 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459388 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovnkube-config\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459506 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459418 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovn-node-metrics-cert\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459506 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459440 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-socket-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.459506 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459463 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-device-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.459506 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459487 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459509 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-etc-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459552 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovnkube-script-lib\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459574 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-cnibin\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459633 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-device-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-etc-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysctl-conf\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.459713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-k8s-cni-cncf-io\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459736 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-socket-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459742 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-hostroot\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.459810 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459819 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-hostroot\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459853 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-slash\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459883 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-cnibin\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459928 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-k8s-cni-cncf-io\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459922 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.459806 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-slash\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460030 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.460011 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:23:37.959972103 +0000 UTC m=+3.018142423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460060 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-systemd\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460093 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-tmp\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460131 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e73e771e-49c0-488f-b43c-04ee31f13507-multus-daemon-config\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460141 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovnkube-config\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-systemd\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460195 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-log-socket\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460264 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-registration-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-log-socket\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovnkube-script-lib\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460379 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-sys-fs\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460404 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dfc25338-688b-4fa6-8c24-336aae6fdc53-serviceca\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-tuned\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-registration-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.460504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc9v2\" (UniqueName: \"kubernetes.io/projected/223c4307-56a0-493b-a586-91711c510cae-kube-api-access-bc9v2\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460735 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e73e771e-49c0-488f-b43c-04ee31f13507-multus-daemon-config\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460810 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-sys-fs\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460812 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dfc25338-688b-4fa6-8c24-336aae6fdc53-serviceca\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460912 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-cni-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460957 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-var-lib-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460981 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-run-ovn-kubernetes\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-var-lib-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.460997 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-cni-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-cni-netd\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461016 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-run-ovn-kubernetes\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b5a810e-469d-4382-8776-f924b7d44227-agent-certs\") pod \"konnectivity-agent-wz9wd\" (UID: \"2b5a810e-469d-4382-8776-f924b7d44227\") " pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-var-lib-kubelet\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-cni-netd\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461080 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-system-cni-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461104 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-run-netns\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461130 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461152 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-ovn\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-system-cni-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461176 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v444\" (UniqueName: \"kubernetes.io/projected/4ef844ab-b52b-4d24-b468-d86504f8baee-kube-api-access-7v444\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-run-netns\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461203 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461197 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-openvswitch\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-host-slash\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461243 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-run-ovn\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461253 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-socket-dir-parent\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461292 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-cni-multus\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461320 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-kubelet\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461309 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-socket-dir-parent\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461365 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-systemd-units\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461391 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjltj\" (UniqueName: \"kubernetes.io/projected/e63cd3b2-0087-4fe8-91cc-3cae773f6355-kube-api-access-wjltj\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461432 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-os-release\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461458 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-systemd\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223c4307-56a0-493b-a586-91711c510cae-tmp-dir\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461517 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-kubelet\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.461951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-systemd-units\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-kubelet\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-os-release\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461612 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krgzm\" (UniqueName: \"kubernetes.io/projected/372a1cfa-9b38-46b3-a54a-979f6903a961-kube-api-access-krgzm\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461613 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-kubelet\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461738 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfc25338-688b-4fa6-8c24-336aae6fdc53-host\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461733 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-cni-multus\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461830 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-node-log\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461869 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfc25338-688b-4fa6-8c24-336aae6fdc53-host\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461926 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-node-log\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461924 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-etc-selinux\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461977 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.461980 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-etc-selinux\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462095 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462125 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jrwn\" (UniqueName: \"kubernetes.io/projected/dfc25338-688b-4fa6-8c24-336aae6fdc53-kube-api-access-8jrwn\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a810e-469d-4382-8776-f924b7d44227-konnectivity-ca\") pod \"konnectivity-agent-wz9wd\" (UID: \"2b5a810e-469d-4382-8776-f924b7d44227\") " pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysconfig\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.462819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462211 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffxm9\" (UniqueName: \"kubernetes.io/projected/092e0688-c9d4-4abf-aa2e-f41656eca37d-kube-api-access-ffxm9\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462237 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-multus-certs\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-kubernetes\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/223c4307-56a0-493b-a586-91711c510cae-hosts-file\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462326 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-conf-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462365 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-cni-bin\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462390 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-env-overrides\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysctl-d\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-run\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462467 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-cnibin\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462496 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbs7z\" (UniqueName: \"kubernetes.io/projected/e73e771e-49c0-488f-b43c-04ee31f13507-kube-api-access-pbs7z\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-kubelet-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462557 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e63cd3b2-0087-4fe8-91cc-3cae773f6355-host-cni-bin\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462557 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462560 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-multus-certs\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.464378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462620 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-cnibin\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462690 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/372a1cfa-9b38-46b3-a54a-979f6903a961-kubelet-dir\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.462797 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-multus-conf-dir\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463030 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-os-release\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463059 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-system-cni-dir\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463085 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-sys\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463113 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm7rx\" (UniqueName: \"kubernetes.io/projected/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-kube-api-access-cm7rx\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463143 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e63cd3b2-0087-4fe8-91cc-3cae773f6355-env-overrides\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ef844ab-b52b-4d24-b468-d86504f8baee-system-cni-dir\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463242 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-os-release\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-lib-modules\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463284 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e73e771e-49c0-488f-b43c-04ee31f13507-cni-binary-copy\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-modprobe-d\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-host\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463384 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-netns\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465130 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463519 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-run-netns\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463569 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-cni-bin\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463605 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-etc-kubernetes\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463676 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-host-var-lib-cni-bin\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ef844ab-b52b-4d24-b468-d86504f8baee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463774 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73e771e-49c0-488f-b43c-04ee31f13507-etc-kubernetes\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e63cd3b2-0087-4fe8-91cc-3cae773f6355-ovn-node-metrics-cert\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.465658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.463972 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e73e771e-49c0-488f-b43c-04ee31f13507-cni-binary-copy\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.474535 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.474504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jrwn\" (UniqueName: \"kubernetes.io/projected/dfc25338-688b-4fa6-8c24-336aae6fdc53-kube-api-access-8jrwn\") pod \"node-ca-gsk6p\" (UID: \"dfc25338-688b-4fa6-8c24-336aae6fdc53\") " pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.474641 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.474603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krgzm\" (UniqueName: \"kubernetes.io/projected/372a1cfa-9b38-46b3-a54a-979f6903a961-kube-api-access-krgzm\") pod \"aws-ebs-csi-driver-node-blnhz\" (UID: \"372a1cfa-9b38-46b3-a54a-979f6903a961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.475442 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.475284 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:37.475442 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.475308 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:37.475442 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.475321 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:37.475442 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.475438 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:37.975420987 +0000 UTC m=+3.033591304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:37.476033 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.476015 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjltj\" (UniqueName: \"kubernetes.io/projected/e63cd3b2-0087-4fe8-91cc-3cae773f6355-kube-api-access-wjltj\") pod \"ovnkube-node-spfzb\" (UID: \"e63cd3b2-0087-4fe8-91cc-3cae773f6355\") " pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.476162 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.476141 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v444\" (UniqueName: \"kubernetes.io/projected/4ef844ab-b52b-4d24-b468-d86504f8baee-kube-api-access-7v444\") pod \"multus-additional-cni-plugins-vjlst\" (UID: \"4ef844ab-b52b-4d24-b468-d86504f8baee\") " pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.479789 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.479766 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:18:36 +0000 UTC" deadline="2028-02-01 17:13:09.0472986 +0000 UTC" Jun 02 15:23:37.479789 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.479788 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14617h49m31.567513867s" Jun 02 15:23:37.482402 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.482375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffxm9\" (UniqueName: \"kubernetes.io/projected/092e0688-c9d4-4abf-aa2e-f41656eca37d-kube-api-access-ffxm9\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.485148 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.484928 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbs7z\" (UniqueName: \"kubernetes.io/projected/e73e771e-49c0-488f-b43c-04ee31f13507-kube-api-access-pbs7z\") pod \"multus-bk74b\" (UID: \"e73e771e-49c0-488f-b43c-04ee31f13507\") " pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.490401 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.490335 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" event={"ID":"36129781e8a462dc5fcfc447b4f88f8a","Type":"ContainerStarted","Data":"e6df1ea5f13336f9e9bc9a18ff2445589f8f4160314390d6607eae21f7429c5a"} Jun 02 15:23:37.491640 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.491616 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" event={"ID":"d8fb5d6b57d05baaccb153cf6066385d","Type":"ContainerStarted","Data":"a764fcbab0e270691a1e8b762fd852aa092cb0de153b515fa35eb4f49e23ffcc"} Jun 02 15:23:37.564796 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564758 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysctl-d\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564811 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-run\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564837 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-sys\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564860 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cm7rx\" (UniqueName: \"kubernetes.io/projected/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-kube-api-access-cm7rx\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564886 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-lib-modules\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564911 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-modprobe-d\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564923 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysctl-d\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-sys\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-host\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.564983 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564932 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-host\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565010 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-iptables-alerter-script\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-lib-modules\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.564949 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-run\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v546m\" (UniqueName: \"kubernetes.io/projected/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-kube-api-access-v546m\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565120 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysctl-conf\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565153 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-tmp\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565012 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-modprobe-d\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565180 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-tuned\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565205 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bc9v2\" (UniqueName: \"kubernetes.io/projected/223c4307-56a0-493b-a586-91711c510cae-kube-api-access-bc9v2\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565262 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b5a810e-469d-4382-8776-f924b7d44227-agent-certs\") pod \"konnectivity-agent-wz9wd\" (UID: \"2b5a810e-469d-4382-8776-f924b7d44227\") " pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysctl-conf\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565287 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-var-lib-kubelet\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565332 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-var-lib-kubelet\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565340 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-host-slash\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565390 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-systemd\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565415 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223c4307-56a0-493b-a586-91711c510cae-tmp-dir\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565445 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a810e-469d-4382-8776-f924b7d44227-konnectivity-ca\") pod \"konnectivity-agent-wz9wd\" (UID: \"2b5a810e-469d-4382-8776-f924b7d44227\") " pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565471 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysconfig\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565486 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-iptables-alerter-script\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565499 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-kubernetes\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565635 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-sysconfig\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565694 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-host-slash\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565759 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-systemd\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-kubernetes\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.565828 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565830 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/223c4307-56a0-493b-a586-91711c510cae-hosts-file\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.566539 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.565883 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/223c4307-56a0-493b-a586-91711c510cae-hosts-file\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.566539 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.566026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a810e-469d-4382-8776-f924b7d44227-konnectivity-ca\") pod \"konnectivity-agent-wz9wd\" (UID: \"2b5a810e-469d-4382-8776-f924b7d44227\") " pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.566539 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.566177 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223c4307-56a0-493b-a586-91711c510cae-tmp-dir\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.568148 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.568121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-etc-tuned\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.568248 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.568157 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b5a810e-469d-4382-8776-f924b7d44227-agent-certs\") pod \"konnectivity-agent-wz9wd\" (UID: \"2b5a810e-469d-4382-8776-f924b7d44227\") " pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.568290 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.568254 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-tmp\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.579694 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.579669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm7rx\" (UniqueName: \"kubernetes.io/projected/35c1358b-8143-4c3f-b66f-6cc3f7d0183a-kube-api-access-cm7rx\") pod \"tuned-bzzs6\" (UID: \"35c1358b-8143-4c3f-b66f-6cc3f7d0183a\") " pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.580660 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.580639 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v546m\" (UniqueName: \"kubernetes.io/projected/0ed2fa7b-6d0a-45da-be45-9efab06eab6a-kube-api-access-v546m\") pod \"iptables-alerter-cm9s8\" (UID: \"0ed2fa7b-6d0a-45da-be45-9efab06eab6a\") " pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.580852 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.580830 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc9v2\" (UniqueName: \"kubernetes.io/projected/223c4307-56a0-493b-a586-91711c510cae-kube-api-access-bc9v2\") pod \"node-resolver-25mpd\" (UID: \"223c4307-56a0-493b-a586-91711c510cae\") " pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.654974 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.654885 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bk74b" Jun 02 15:23:37.661669 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.661644 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:23:37.669999 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.669942 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" Jun 02 15:23:37.676658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.676627 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gsk6p" Jun 02 15:23:37.683340 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.683314 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjlst" Jun 02 15:23:37.692054 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.692029 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cm9s8" Jun 02 15:23:37.700670 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.700646 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:37.713410 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.713385 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" Jun 02 15:23:37.719128 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.719105 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-25mpd" Jun 02 15:23:37.968520 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:37.968449 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:37.968633 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.968597 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:37.968681 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:37.968653 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:23:38.96863381 +0000 UTC m=+4.026804124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:38.069148 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.069120 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:38.069309 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.069266 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:38.069309 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.069285 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:38.069309 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.069294 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:38.069455 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.069365 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:39.06932743 +0000 UTC m=+4.127497738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:38.450634 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.450603 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63cd3b2_0087_4fe8_91cc_3cae773f6355.slice/crio-089383739c29b197001a15dca931ebf566ff395232ce506e675c262221dea5a4 WatchSource:0}: Error finding container 089383739c29b197001a15dca931ebf566ff395232ce506e675c262221dea5a4: Status 404 returned error can't find the container with id 089383739c29b197001a15dca931ebf566ff395232ce506e675c262221dea5a4 Jun 02 15:23:38.453412 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.453384 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed2fa7b_6d0a_45da_be45_9efab06eab6a.slice/crio-fbf35a147afe4feff464ebbbd03fa84f3f083499e4c6ea162832ec0e437ad917 WatchSource:0}: Error finding container fbf35a147afe4feff464ebbbd03fa84f3f083499e4c6ea162832ec0e437ad917: Status 404 returned error can't find the container with id fbf35a147afe4feff464ebbbd03fa84f3f083499e4c6ea162832ec0e437ad917 Jun 02 15:23:38.457616 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.456147 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef844ab_b52b_4d24_b468_d86504f8baee.slice/crio-8a5c9290a70f603527ad2411e392b132c22a6ac5170b5be77069380bed236d20 WatchSource:0}: Error finding container 8a5c9290a70f603527ad2411e392b132c22a6ac5170b5be77069380bed236d20: Status 404 returned error can't find the container with id 8a5c9290a70f603527ad2411e392b132c22a6ac5170b5be77069380bed236d20 Jun 02 15:23:38.457616 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.456970 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223c4307_56a0_493b_a586_91711c510cae.slice/crio-71ff1940c74dd89c872763df7b5e5bd67180194704e26d49cda51c314ba9481d WatchSource:0}: Error finding container 71ff1940c74dd89c872763df7b5e5bd67180194704e26d49cda51c314ba9481d: Status 404 returned error can't find the container with id 71ff1940c74dd89c872763df7b5e5bd67180194704e26d49cda51c314ba9481d Jun 02 15:23:38.457867 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.457750 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c1358b_8143_4c3f_b66f_6cc3f7d0183a.slice/crio-4800b606e5ee22cb77b3a3cad508a316a57065efb2cc6c4e2a7fc8d7c01edd95 WatchSource:0}: Error finding container 4800b606e5ee22cb77b3a3cad508a316a57065efb2cc6c4e2a7fc8d7c01edd95: Status 404 returned error can't find the container with id 4800b606e5ee22cb77b3a3cad508a316a57065efb2cc6c4e2a7fc8d7c01edd95 Jun 02 15:23:38.460047 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.460012 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc25338_688b_4fa6_8c24_336aae6fdc53.slice/crio-ab31f0b87bd4a8fcca43bac43635c214a310a8de13b847344730d692c9389d88 WatchSource:0}: Error finding container ab31f0b87bd4a8fcca43bac43635c214a310a8de13b847344730d692c9389d88: Status 404 returned error can't find the container with id ab31f0b87bd4a8fcca43bac43635c214a310a8de13b847344730d692c9389d88 Jun 02 15:23:38.469644 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:23:38.468690 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372a1cfa_9b38_46b3_a54a_979f6903a961.slice/crio-44cecebde20e245b1e8abe91e2b6c1fe3cfea7e223074ed663681f34ef561f75 WatchSource:0}: Error finding container 44cecebde20e245b1e8abe91e2b6c1fe3cfea7e223074ed663681f34ef561f75: Status 404 returned error can't find the container with id 44cecebde20e245b1e8abe91e2b6c1fe3cfea7e223074ed663681f34ef561f75 Jun 02 15:23:38.480000 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.479962 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:18:36 +0000 UTC" deadline="2027-12-05 23:05:30.488395112 +0000 UTC" Jun 02 15:23:38.480090 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.480012 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13231h41m52.008388005s" Jun 02 15:23:38.483921 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.483898 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:38.484054 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.484029 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:38.495444 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.495418 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gsk6p" event={"ID":"dfc25338-688b-4fa6-8c24-336aae6fdc53","Type":"ContainerStarted","Data":"ab31f0b87bd4a8fcca43bac43635c214a310a8de13b847344730d692c9389d88"} Jun 02 15:23:38.499399 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.499372 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" event={"ID":"35c1358b-8143-4c3f-b66f-6cc3f7d0183a","Type":"ContainerStarted","Data":"4800b606e5ee22cb77b3a3cad508a316a57065efb2cc6c4e2a7fc8d7c01edd95"} Jun 02 15:23:38.500494 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.500468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cm9s8" event={"ID":"0ed2fa7b-6d0a-45da-be45-9efab06eab6a","Type":"ContainerStarted","Data":"fbf35a147afe4feff464ebbbd03fa84f3f083499e4c6ea162832ec0e437ad917"} Jun 02 15:23:38.501491 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.501469 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wz9wd" event={"ID":"2b5a810e-469d-4382-8776-f924b7d44227","Type":"ContainerStarted","Data":"1f0c56f0881a7a2c870eb44b9f49ad19bd092c7f19d509f53d1f2c97a927d215"} Jun 02 15:23:38.502409 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.502390 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-25mpd" event={"ID":"223c4307-56a0-493b-a586-91711c510cae","Type":"ContainerStarted","Data":"71ff1940c74dd89c872763df7b5e5bd67180194704e26d49cda51c314ba9481d"} Jun 02 15:23:38.503266 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.503248 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerStarted","Data":"8a5c9290a70f603527ad2411e392b132c22a6ac5170b5be77069380bed236d20"} Jun 02 15:23:38.504153 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.504129 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"089383739c29b197001a15dca931ebf566ff395232ce506e675c262221dea5a4"} Jun 02 15:23:38.504891 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.504875 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" event={"ID":"372a1cfa-9b38-46b3-a54a-979f6903a961","Type":"ContainerStarted","Data":"44cecebde20e245b1e8abe91e2b6c1fe3cfea7e223074ed663681f34ef561f75"} Jun 02 15:23:38.507228 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.507205 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bk74b" event={"ID":"e73e771e-49c0-488f-b43c-04ee31f13507","Type":"ContainerStarted","Data":"5094f101f91374f08c75ae015378aeaca10f065dab4e220eb1eb00e5e9ef4fb2"} Jun 02 15:23:38.976189 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:38.976099 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:38.976336 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.976252 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:38.976336 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:38.976318 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:23:40.97629863 +0000 UTC m=+6.034468943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:39.077593 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:39.077504 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:39.077748 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:39.077670 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:39.077748 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:39.077690 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:39.077748 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:39.077704 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:39.077925 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:39.077766 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:41.077745551 +0000 UTC m=+6.135915878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:39.484532 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:39.484500 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:39.484973 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:39.484632 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:39.517313 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:39.517274 2555 generic.go:358] "Generic (PLEG): container finished" podID="36129781e8a462dc5fcfc447b4f88f8a" containerID="1fb920665d74554b5331a338118c6c7d43bc08919c8ecb5004dfa866c6fd26d1" exitCode=0 Jun 02 15:23:39.517518 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:39.517486 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" event={"ID":"36129781e8a462dc5fcfc447b4f88f8a","Type":"ContainerDied","Data":"1fb920665d74554b5331a338118c6c7d43bc08919c8ecb5004dfa866c6fd26d1"} Jun 02 15:23:39.541167 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:39.540690 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" event={"ID":"d8fb5d6b57d05baaccb153cf6066385d","Type":"ContainerStarted","Data":"d1e3b72815b6d1428ce72c47c33a4ed9e79ceaccf51c681efe6bacd90b5340c2"} Jun 02 15:23:40.484131 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:40.484028 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:40.484305 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:40.484176 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:40.582714 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:40.582683 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" event={"ID":"36129781e8a462dc5fcfc447b4f88f8a","Type":"ContainerStarted","Data":"410bd7ef136e79a350edb81c937b57c88b71f980ccacc26c163ba23185cac79d"} Jun 02 15:23:40.609362 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:40.605471 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" podStartSLOduration=4.605452681 podStartE2EDuration="4.605452681s" podCreationTimestamp="2026-06-02 15:23:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:23:39.564955754 +0000 UTC m=+4.623126081" watchObservedRunningTime="2026-06-02 15:23:40.605452681 +0000 UTC m=+5.663623008" Jun 02 15:23:40.994780 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:40.994690 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:40.994948 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:40.994876 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:40.994948 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:40.994941 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:23:44.99492309 +0000 UTC m=+10.053093395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:41.096636 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:41.095935 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:41.096636 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:41.096108 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:41.096636 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:41.096127 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:41.096636 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:41.096151 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:41.096636 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:41.096213 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:45.096193221 +0000 UTC m=+10.154363526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:41.486651 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:41.485868 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:41.486651 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:41.486015 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:42.483979 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:42.483946 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:42.484519 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:42.484079 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:43.486606 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:43.486572 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:43.487081 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:43.486695 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:44.483962 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:44.483819 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:44.483962 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:44.483942 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:44.997077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:44.997026 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" podStartSLOduration=8.997008379 podStartE2EDuration="8.997008379s" podCreationTimestamp="2026-06-02 15:23:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:23:40.614063445 +0000 UTC m=+5.672233773" watchObservedRunningTime="2026-06-02 15:23:44.997008379 +0000 UTC m=+10.055178706" Jun 02 15:23:44.997613 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:44.997595 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-j82lr"] Jun 02 15:23:45.000433 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.000414 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.000518 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.000482 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:45.030112 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.030063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:45.030273 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.030224 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:45.030328 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.030301 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:23:53.030280372 +0000 UTC m=+18.088450677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:45.130558 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.130518 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:45.130719 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.130577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6374b65-94c2-4ecd-b144-17c622038c28-kubelet-config\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.130792 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.130750 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:45.130792 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.130772 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:45.130792 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.130786 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:45.130927 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.130841 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:53.13082218 +0000 UTC m=+18.188992501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:45.130999 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.130972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6374b65-94c2-4ecd-b144-17c622038c28-dbus\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.131062 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.131039 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.231768 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6374b65-94c2-4ecd-b144-17c622038c28-kubelet-config\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.231841 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6374b65-94c2-4ecd-b144-17c622038c28-dbus\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.231876 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6374b65-94c2-4ecd-b144-17c622038c28-kubelet-config\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.231906 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.232030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6374b65-94c2-4ecd-b144-17c622038c28-dbus\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.232051 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:45.232207 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.232181 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret podName:c6374b65-94c2-4ecd-b144-17c622038c28 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:45.732101096 +0000 UTC m=+10.790271406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret") pod "global-pull-secret-syncer-j82lr" (UID: "c6374b65-94c2-4ecd-b144-17c622038c28") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:45.484517 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.484276 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:45.484683 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.484611 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:45.737401 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:45.736764 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:45.737401 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.736917 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:45.737401 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:45.736983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret podName:c6374b65-94c2-4ecd-b144-17c622038c28 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:46.736964238 +0000 UTC m=+11.795134558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret") pod "global-pull-secret-syncer-j82lr" (UID: "c6374b65-94c2-4ecd-b144-17c622038c28") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:46.484169 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:46.483634 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:46.484169 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:46.483768 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:46.484169 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:46.483640 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:46.484169 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:46.484025 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:46.744911 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:46.744809 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:46.745116 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:46.744990 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:46.745116 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:46.745054 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret podName:c6374b65-94c2-4ecd-b144-17c622038c28 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:48.74503872 +0000 UTC m=+13.803209040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret") pod "global-pull-secret-syncer-j82lr" (UID: "c6374b65-94c2-4ecd-b144-17c622038c28") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:47.484219 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:47.484092 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:47.484708 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:47.484229 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:48.484203 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:48.484160 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:48.484394 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:48.484160 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:48.484394 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:48.484310 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:48.484807 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:48.484401 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:48.759810 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:48.759731 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:48.759977 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:48.759865 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:48.759977 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:48.759921 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret podName:c6374b65-94c2-4ecd-b144-17c622038c28 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:52.759907126 +0000 UTC m=+17.818077434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret") pod "global-pull-secret-syncer-j82lr" (UID: "c6374b65-94c2-4ecd-b144-17c622038c28") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:49.486906 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:49.486868 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:49.487308 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:49.486982 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:50.484339 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:50.484305 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:50.484519 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:50.484462 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:50.484722 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:50.484702 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:50.484834 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:50.484805 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:51.483797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:51.483759 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:51.484194 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:51.483894 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:52.483639 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:52.483604 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:52.483819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:52.483604 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:52.483819 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:52.483746 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:52.483819 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:52.483801 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:52.790265 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:52.790230 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:52.790439 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:52.790365 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:52.790439 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:52.790433 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret podName:c6374b65-94c2-4ecd-b144-17c622038c28 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:00.790415575 +0000 UTC m=+25.848585882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret") pod "global-pull-secret-syncer-j82lr" (UID: "c6374b65-94c2-4ecd-b144-17c622038c28") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:53.092005 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:53.091964 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:53.092172 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.092118 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:53.092235 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.092187 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:24:09.092171884 +0000 UTC m=+34.150342203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:53.193152 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:53.193099 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:53.193340 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.193288 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:53.193340 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.193313 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:53.193340 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.193327 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:53.193511 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.193408 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:09.193387741 +0000 UTC m=+34.251558065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:53.483664 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:53.483573 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:53.483809 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:53.483693 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:54.483706 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:54.483669 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:54.484101 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:54.483670 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:54.484101 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:54.483807 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:54.484101 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:54.483890 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:55.484619 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:55.484579 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:55.485027 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:55.484697 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:56.484048 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:56.484016 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:56.484292 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:56.484050 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:56.484292 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:56.484135 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:56.484292 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:56.484251 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:57.484265 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.484061 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:57.485169 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:57.484390 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:57.617227 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.617189 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bk74b" event={"ID":"e73e771e-49c0-488f-b43c-04ee31f13507","Type":"ContainerStarted","Data":"879e7da3e7c469bec5c4136a58998ef734241c57f8af436fdf0da4b79d273962"} Jun 02 15:23:57.618423 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.618398 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gsk6p" event={"ID":"dfc25338-688b-4fa6-8c24-336aae6fdc53","Type":"ContainerStarted","Data":"87468ea6ad9c5c788a30ccc47508dfec969101b5e0e5a0b44d8416a49ee7954f"} Jun 02 15:23:57.619508 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.619481 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" event={"ID":"35c1358b-8143-4c3f-b66f-6cc3f7d0183a","Type":"ContainerStarted","Data":"6541983711d977acd0399e1e0615f3524afee70a9d64e2b96d1c53613948b0de"} Jun 02 15:23:57.620654 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.620636 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wz9wd" event={"ID":"2b5a810e-469d-4382-8776-f924b7d44227","Type":"ContainerStarted","Data":"f973e8fe94d0fce65ea7be371e5118b10452c6b96bbbf6be295e364fe57971e5"} Jun 02 15:23:57.622082 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.622062 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-25mpd" event={"ID":"223c4307-56a0-493b-a586-91711c510cae","Type":"ContainerStarted","Data":"d5d146fdb024864f931133b6b26d61b414c1d69b6ea46ede7233c72f5db2d77c"} Jun 02 15:23:57.623384 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.623361 2555 generic.go:358] "Generic (PLEG): container finished" podID="4ef844ab-b52b-4d24-b468-d86504f8baee" containerID="25fb18fab8c7513141e290b136964450d994d5d37ba841cc036da9f2e3e6b063" exitCode=0 Jun 02 15:23:57.623467 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.623438 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerDied","Data":"25fb18fab8c7513141e290b136964450d994d5d37ba841cc036da9f2e3e6b063"} Jun 02 15:23:57.628819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.628788 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"cbe2126c609fb2323a858e11d8653e94b39743243a8a05cf0aceb5cf026e5708"} Jun 02 15:23:57.628899 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.628829 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"d2988f75480b5ce49976142725c11d5c04d665f9190f745485834d23d9c824c2"} Jun 02 15:23:57.628899 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.628844 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"9aa010462e422e0640274a65dcaf0e1a968f2fa6c34b9de3aa1e2b0895de05ee"} Jun 02 15:23:57.628899 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.628857 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"2872b114ea51b66cbcffc80e9009072fe9de86236a991d9f767c2e95fffe8f6f"} Jun 02 15:23:57.628899 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.628872 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"f8ed003481c1c78854a496abcef719694bcf13c6e60b5d35cd4214c7a101281c"} Jun 02 15:23:57.628899 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.628885 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"ef5b66a5556b26ab90b62a44147a981ce71033430fd1088093587ff1834649ab"} Jun 02 15:23:57.629889 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.629870 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" event={"ID":"372a1cfa-9b38-46b3-a54a-979f6903a961","Type":"ContainerStarted","Data":"dfe4615958fecbf77611857e0e6c5f2b09159a76e99f03fde3f0f58e9c889111"} Jun 02 15:23:57.742247 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.742191 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bk74b" podStartSLOduration=4.493603791 podStartE2EDuration="22.742175295s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.470534547 +0000 UTC m=+3.528704857" lastFinishedPulling="2026-06-02 15:23:56.719106055 +0000 UTC m=+21.777276361" observedRunningTime="2026-06-02 15:23:57.704977072 +0000 UTC m=+22.763147399" watchObservedRunningTime="2026-06-02 15:23:57.742175295 +0000 UTC m=+22.800345620" Jun 02 15:23:57.798953 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.798889 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bzzs6" podStartSLOduration=4.601706839 podStartE2EDuration="22.798867216s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.460224994 +0000 UTC m=+3.518395300" lastFinishedPulling="2026-06-02 15:23:56.657385357 +0000 UTC m=+21.715555677" observedRunningTime="2026-06-02 15:23:57.742452967 +0000 UTC m=+22.800623332" watchObservedRunningTime="2026-06-02 15:23:57.798867216 +0000 UTC m=+22.857037543" Jun 02 15:23:57.799123 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.799040 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-25mpd" podStartSLOduration=4.648825419 podStartE2EDuration="22.799033672s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.45942162 +0000 UTC m=+3.517591928" lastFinishedPulling="2026-06-02 15:23:56.609629862 +0000 UTC m=+21.667800181" observedRunningTime="2026-06-02 15:23:57.79707538 +0000 UTC m=+22.855245707" watchObservedRunningTime="2026-06-02 15:23:57.799033672 +0000 UTC m=+22.857203999" Jun 02 15:23:57.851754 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.851702 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wz9wd" podStartSLOduration=4.668740558 podStartE2EDuration="22.85168777s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.469436944 +0000 UTC m=+3.527607253" lastFinishedPulling="2026-06-02 15:23:56.652384162 +0000 UTC m=+21.710554465" observedRunningTime="2026-06-02 15:23:57.851553234 +0000 UTC m=+22.909723562" watchObservedRunningTime="2026-06-02 15:23:57.85168777 +0000 UTC m=+22.909858095" Jun 02 15:23:57.946540 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:57.946456 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gsk6p" podStartSLOduration=9.099666531 podStartE2EDuration="22.946440062s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.468495798 +0000 UTC m=+3.526666104" lastFinishedPulling="2026-06-02 15:23:52.31526933 +0000 UTC m=+17.373439635" observedRunningTime="2026-06-02 15:23:57.903778181 +0000 UTC m=+22.961948510" watchObservedRunningTime="2026-06-02 15:23:57.946440062 +0000 UTC m=+23.004610387" Jun 02 15:23:58.056610 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.056584 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 15:23:58.429565 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.429418 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T15:23:58.056604529Z","UUID":"1448eb64-7caa-4262-9b11-bfc12830c29e","Handler":null,"Name":"","Endpoint":""} Jun 02 15:23:58.431100 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.431078 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 15:23:58.431100 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.431109 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 15:23:58.483856 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.483828 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:23:58.483856 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.483863 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:23:58.484041 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:58.483936 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:23:58.484041 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:58.483982 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:23:58.633560 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.633529 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" event={"ID":"372a1cfa-9b38-46b3-a54a-979f6903a961","Type":"ContainerStarted","Data":"a3725f316de8ac7d51f1f54c492fafc59817d75b5c7a78af2f2d732de910d8b4"} Jun 02 15:23:58.634992 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:58.634918 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cm9s8" event={"ID":"0ed2fa7b-6d0a-45da-be45-9efab06eab6a","Type":"ContainerStarted","Data":"802b3cd14af3a1f45b8eb53a7101fa80051f09afe6d57578c49720d7422e6553"} Jun 02 15:23:59.352851 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.352807 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:59.353584 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.353559 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:59.381081 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.381035 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cm9s8" podStartSLOduration=6.183628518 podStartE2EDuration="24.381019423s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.455340028 +0000 UTC m=+3.513510337" lastFinishedPulling="2026-06-02 15:23:56.652730929 +0000 UTC m=+21.710901242" observedRunningTime="2026-06-02 15:23:58.666463757 +0000 UTC m=+23.724634098" watchObservedRunningTime="2026-06-02 15:23:59.381019423 +0000 UTC m=+24.439189752" Jun 02 15:23:59.484206 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.484131 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:23:59.484340 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:23:59.484271 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:23:59.639144 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.639096 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" event={"ID":"372a1cfa-9b38-46b3-a54a-979f6903a961","Type":"ContainerStarted","Data":"f90829a891c8deee6c6d9c5dd286682ba0594b1e6fa715ec2433b2bcdc3fc7a0"} Jun 02 15:23:59.642604 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.642582 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"ec8e0003ced9a41ceac17e5c55b56223f1ef1694b64f2abbc4ee70091f7251e1"} Jun 02 15:23:59.643089 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.643059 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:59.643720 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.643701 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wz9wd" Jun 02 15:23:59.668756 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:23:59.668698 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blnhz" podStartSLOduration=3.82210211 podStartE2EDuration="24.66867939s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.471836245 +0000 UTC m=+3.530006551" lastFinishedPulling="2026-06-02 15:23:59.318413516 +0000 UTC m=+24.376583831" observedRunningTime="2026-06-02 15:23:59.668559421 +0000 UTC m=+24.726729769" watchObservedRunningTime="2026-06-02 15:23:59.66867939 +0000 UTC m=+24.726849718" Jun 02 15:24:00.484269 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:00.484190 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:00.484428 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:00.484190 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:00.484428 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:00.484289 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:24:00.484428 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:00.484403 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:24:00.854201 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:00.854170 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:00.854735 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:00.854299 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:24:00.854735 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:00.854369 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret podName:c6374b65-94c2-4ecd-b144-17c622038c28 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:16.854342048 +0000 UTC m=+41.912512352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret") pod "global-pull-secret-syncer-j82lr" (UID: "c6374b65-94c2-4ecd-b144-17c622038c28") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:24:01.483814 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:01.483630 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:01.483991 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:01.483926 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:24:01.650094 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:01.649987 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" event={"ID":"e63cd3b2-0087-4fe8-91cc-3cae773f6355","Type":"ContainerStarted","Data":"c326f9b19578fe95653f175b8ba43f24f2a7e1ca248c52e03ab9fea9a86ac499"} Jun 02 15:24:01.686510 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:01.686461 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" podStartSLOduration=8.421728288 podStartE2EDuration="26.686447328s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.45365121 +0000 UTC m=+3.511821528" lastFinishedPulling="2026-06-02 15:23:56.718370253 +0000 UTC m=+21.776540568" observedRunningTime="2026-06-02 15:24:01.684435736 +0000 UTC m=+26.742606078" watchObservedRunningTime="2026-06-02 15:24:01.686447328 +0000 UTC m=+26.744617680" Jun 02 15:24:02.483924 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.483893 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:02.484435 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.483890 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:02.484435 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:02.484010 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:24:02.484435 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:02.484082 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:24:02.656701 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.656617 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:24:02.656701 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.656676 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:24:02.657030 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.657000 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:24:02.695395 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.695366 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:24:02.696731 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:02.696692 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:24:03.483381 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.483327 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:03.483552 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:03.483483 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:24:03.607692 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.607659 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bzvdk"] Jun 02 15:24:03.608159 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.607809 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:03.608159 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:03.607927 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:24:03.613127 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.613098 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j82lr"] Jun 02 15:24:03.613272 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.613213 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:03.613332 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:03.613315 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:24:03.639851 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.639819 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdx58"] Jun 02 15:24:03.658305 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:03.658267 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:03.658464 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:03.658418 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:24:04.661164 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:04.661131 2555 generic.go:358] "Generic (PLEG): container finished" podID="4ef844ab-b52b-4d24-b468-d86504f8baee" containerID="3e85286a56a47cf78ce4e5337300a6fd61f7a31cab352272c88ead985ba6117c" exitCode=0 Jun 02 15:24:04.661638 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:04.661172 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerDied","Data":"3e85286a56a47cf78ce4e5337300a6fd61f7a31cab352272c88ead985ba6117c"} Jun 02 15:24:05.484967 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:05.484802 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:05.485111 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:05.484881 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:05.485111 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:05.485023 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:24:05.485226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:05.484908 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:05.485226 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:05.485126 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:24:05.485321 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:05.485263 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:24:05.664875 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:05.664844 2555 generic.go:358] "Generic (PLEG): container finished" podID="4ef844ab-b52b-4d24-b468-d86504f8baee" containerID="025637d24ed3da793b6b659aab8454dfd474a63bc3118d2ea4b6cc20f6059e6f" exitCode=0 Jun 02 15:24:05.665234 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:05.664910 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerDied","Data":"025637d24ed3da793b6b659aab8454dfd474a63bc3118d2ea4b6cc20f6059e6f"} Jun 02 15:24:06.669045 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:06.669011 2555 generic.go:358] "Generic (PLEG): container finished" podID="4ef844ab-b52b-4d24-b468-d86504f8baee" containerID="8c63ccd181c4061baf5ecf91661f0bc92f37866946cdd67fe0c7f68adc22f2c0" exitCode=0 Jun 02 15:24:06.669637 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:06.669079 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerDied","Data":"8c63ccd181c4061baf5ecf91661f0bc92f37866946cdd67fe0c7f68adc22f2c0"} Jun 02 15:24:07.484292 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:07.484255 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:07.484292 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:07.484294 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:07.484505 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:07.484255 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:07.484505 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:07.484406 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdx58" podUID="d3f9f513-f3a0-4202-aa2f-89a9a686de62" Jun 02 15:24:07.484505 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:07.484486 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:24:07.484621 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:07.484566 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j82lr" podUID="c6374b65-94c2-4ecd-b144-17c622038c28" Jun 02 15:24:09.116445 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.116406 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:09.117087 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.116576 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:09.117087 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.116653 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:24:41.116631255 +0000 UTC m=+66.174801570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:09.217067 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.217037 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:09.217240 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.217220 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:24:09.217299 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.217246 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:24:09.217299 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.217255 2555 projected.go:194] Error preparing data for projected volume kube-api-access-fxnj6 for pod openshift-network-diagnostics/network-check-target-xdx58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:09.217405 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.217316 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6 podName:d3f9f513-f3a0-4202-aa2f-89a9a686de62 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:41.217298138 +0000 UTC m=+66.275468464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxnj6" (UniqueName: "kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6") pod "network-check-target-xdx58" (UID: "d3f9f513-f3a0-4202-aa2f-89a9a686de62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:09.275612 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.275587 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeReady" Jun 02 15:24:09.275768 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.275742 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 15:24:09.336877 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.336847 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d8d4d4f7f-k2b56"] Jun 02 15:24:09.340747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.340724 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.343543 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.343525 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 15:24:09.343643 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.343568 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 15:24:09.344214 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.344193 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kbhxp\"" Jun 02 15:24:09.344542 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.344521 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 15:24:09.350425 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.350405 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 15:24:09.365979 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.365961 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8d4d4f7f-k2b56"] Jun 02 15:24:09.380053 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.379996 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6s6sk"] Jun 02 15:24:09.385091 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.385073 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:09.391504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.391482 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 15:24:09.391504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.391482 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb47d\"" Jun 02 15:24:09.391682 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.391513 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 15:24:09.391682 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.391639 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 15:24:09.404891 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.404864 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6s6sk"] Jun 02 15:24:09.481515 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.481476 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4c65x"] Jun 02 15:24:09.488150 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.488110 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:09.488150 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.488146 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:09.488382 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.488204 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:09.488457 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.488403 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.493868 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.493848 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:24:09.494846 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.494825 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:24:09.494940 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.494845 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 15:24:09.494940 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.494925 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:24:09.495091 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.495076 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqlt7\"" Jun 02 15:24:09.495222 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.495204 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 15:24:09.495956 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.495936 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hhkk\"" Jun 02 15:24:09.496134 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.496116 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8csp4\"" Jun 02 15:24:09.496314 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.496289 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:24:09.509058 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.509034 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4c65x"] Jun 02 15:24:09.518413 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfghz\" (UniqueName: \"kubernetes.io/projected/8a40dda6-f5c5-4748-9156-584008e60fd9-kube-api-access-xfghz\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:09.518531 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-ca-trust-extracted\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518531 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518489 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518531 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-trusted-ca\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518531 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518521 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crxdz\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-kube-api-access-crxdz\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518675 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:09.518675 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-image-registry-private-configuration\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518675 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-bound-sa-token\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518675 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518593 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-certificates\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.518675 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.518610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-installation-pull-secrets\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.619546 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619507 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfghz\" (UniqueName: \"kubernetes.io/projected/8a40dda6-f5c5-4748-9156-584008e60fd9-kube-api-access-xfghz\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:09.619546 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36e443ce-99da-4941-b80d-9da759ccd7c6-config-volume\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.619791 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgh7x\" (UniqueName: \"kubernetes.io/projected/36e443ce-99da-4941-b80d-9da759ccd7c6-kube-api-access-kgh7x\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.619791 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619717 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-ca-trust-extracted\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.619791 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.619791 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e443ce-99da-4941-b80d-9da759ccd7c6-tmp-dir\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.619966 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619932 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.619966 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619959 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-trusted-ca\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620047 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.619982 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crxdz\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-kube-api-access-crxdz\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620047 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620007 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:09.620047 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-image-registry-private-configuration\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620061 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-bound-sa-token\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620092 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-certificates\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620114 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-installation-pull-secrets\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-ca-trust-extracted\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.620061 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.620161 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:09.620184 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.620118 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:09.620516 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.620232 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:10.120201211 +0000 UTC m=+35.178371521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:09.620516 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.620388 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:24:10.120370045 +0000 UTC m=+35.178540400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:09.620887 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.620862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-certificates\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.621036 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.621010 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-trusted-ca\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.624299 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.624273 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-installation-pull-secrets\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.624430 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.624388 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-image-registry-private-configuration\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.645135 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.645074 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-bound-sa-token\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.647666 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.647632 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crxdz\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-kube-api-access-crxdz\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:09.648250 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.648225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfghz\" (UniqueName: \"kubernetes.io/projected/8a40dda6-f5c5-4748-9156-584008e60fd9-kube-api-access-xfghz\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:09.720616 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.720580 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36e443ce-99da-4941-b80d-9da759ccd7c6-config-volume\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.720616 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.720615 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgh7x\" (UniqueName: \"kubernetes.io/projected/36e443ce-99da-4941-b80d-9da759ccd7c6-kube-api-access-kgh7x\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.720819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.720644 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.720819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.720662 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e443ce-99da-4941-b80d-9da759ccd7c6-tmp-dir\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.720819 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.720758 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:09.720923 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:09.720833 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:10.22081371 +0000 UTC m=+35.278984013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:09.721034 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.721007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e443ce-99da-4941-b80d-9da759ccd7c6-tmp-dir\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.721124 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.721108 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36e443ce-99da-4941-b80d-9da759ccd7c6-config-volume\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:09.733831 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:09.733807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgh7x\" (UniqueName: \"kubernetes.io/projected/36e443ce-99da-4941-b80d-9da759ccd7c6-kube-api-access-kgh7x\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:10.123306 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:10.123131 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:10.123704 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:10.123318 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:10.123704 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.123271 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:10.123704 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.123384 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:10.123704 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.123446 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:24:11.12343176 +0000 UTC m=+36.181602064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:10.123704 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.123458 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:10.123704 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.123506 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:11.123494818 +0000 UTC m=+36.181665122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:10.223692 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:10.223660 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:10.223856 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.223809 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:10.223891 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:10.223873 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:11.223858976 +0000 UTC m=+36.282029279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:11.131115 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:11.131078 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:11.131115 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:11.131121 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:11.131648 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.131226 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:11.131648 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.131246 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:11.131648 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.131250 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:11.131648 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.131298 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:13.131285551 +0000 UTC m=+38.189455860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:11.131648 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.131312 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:24:13.131306345 +0000 UTC m=+38.189476653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:11.231514 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:11.231480 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:11.231716 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.231655 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:11.231781 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:11.231732 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:13.231712204 +0000 UTC m=+38.289882531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:13.150561 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:13.150527 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:13.150561 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:13.150564 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:13.151032 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.150735 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:13.151032 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.150765 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:13.151032 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.150740 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:13.151032 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.150830 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:24:17.150809067 +0000 UTC m=+42.208979391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:13.151032 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.150864 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:17.150852925 +0000 UTC m=+42.209023230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:13.251628 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:13.251527 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:13.251766 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.251693 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:13.251766 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:13.251757 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:17.251741912 +0000 UTC m=+42.309912216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:16.692013 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:16.691977 2555 generic.go:358] "Generic (PLEG): container finished" podID="4ef844ab-b52b-4d24-b468-d86504f8baee" containerID="e6df2120f5782f2270696a3a44d7759b64999553a92856b8924c3dce20cf957c" exitCode=0 Jun 02 15:24:16.692387 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:16.692040 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerDied","Data":"e6df2120f5782f2270696a3a44d7759b64999553a92856b8924c3dce20cf957c"} Jun 02 15:24:16.879749 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:16.879525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:16.882560 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:16.882532 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6374b65-94c2-4ecd-b144-17c622038c28-original-pull-secret\") pod \"global-pull-secret-syncer-j82lr\" (UID: \"c6374b65-94c2-4ecd-b144-17c622038c28\") " pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:17.000101 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.000021 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j82lr" Jun 02 15:24:17.159789 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.157501 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j82lr"] Jun 02 15:24:17.162563 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:24:17.162534 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6374b65_94c2_4ecd_b144_17c622038c28.slice/crio-f658533539bc90ea7c97a514f8606862f7ec20551a46df4e495db94f6ebc0e88 WatchSource:0}: Error finding container f658533539bc90ea7c97a514f8606862f7ec20551a46df4e495db94f6ebc0e88: Status 404 returned error can't find the container with id f658533539bc90ea7c97a514f8606862f7ec20551a46df4e495db94f6ebc0e88 Jun 02 15:24:17.182961 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.182929 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:17.182961 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.182967 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:17.183115 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.183060 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:17.183115 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.183078 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:17.183115 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.183097 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:17.183115 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.183110 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:25.183094174 +0000 UTC m=+50.241264478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:17.183277 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.183152 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:24:25.183138069 +0000 UTC m=+50.241308378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:17.283392 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.283285 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:17.283533 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.283453 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:17.283533 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:17.283514 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:25.28349997 +0000 UTC m=+50.341670280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:17.529292 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.529258 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2"] Jun 02 15:24:17.559875 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.559809 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.591231 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.591203 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 15:24:17.592051 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.592026 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 15:24:17.592610 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.592591 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k"] Jun 02 15:24:17.596400 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.596382 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 15:24:17.616072 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.616045 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.620612 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.620589 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2"] Jun 02 15:24:17.621384 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.621362 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k"] Jun 02 15:24:17.622160 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.622140 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 15:24:17.622597 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.622496 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 15:24:17.626716 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.626698 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lvqfc\"" Jun 02 15:24:17.639750 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.639729 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k"] Jun 02 15:24:17.639852 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.639845 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.655941 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.655912 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k"] Jun 02 15:24:17.656051 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.656026 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 15:24:17.656207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.656191 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 15:24:17.656242 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.656233 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 15:24:17.656297 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.656282 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 15:24:17.686800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.686769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.686947 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.686815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-tmp\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.686947 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.686888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmn54\" (UniqueName: \"kubernetes.io/projected/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-kube-api-access-fmn54\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.694714 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.694677 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j82lr" event={"ID":"c6374b65-94c2-4ecd-b144-17c622038c28","Type":"ContainerStarted","Data":"f658533539bc90ea7c97a514f8606862f7ec20551a46df4e495db94f6ebc0e88"} Jun 02 15:24:17.697182 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.697155 2555 generic.go:358] "Generic (PLEG): container finished" podID="4ef844ab-b52b-4d24-b468-d86504f8baee" containerID="a3b0011aff92a07ed17fbb6787a4ca0aebbc3cea05082907f6e1a0ddadb598aa" exitCode=0 Jun 02 15:24:17.697287 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.697188 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerDied","Data":"a3b0011aff92a07ed17fbb6787a4ca0aebbc3cea05082907f6e1a0ddadb598aa"} Jun 02 15:24:17.787210 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzpgb\" (UniqueName: \"kubernetes.io/projected/9613b7ad-af40-407e-a536-d9008f7138cd-kube-api-access-bzpgb\") pod \"managed-serviceaccount-addon-agent-7bd54d4464-dx49k\" (UID: \"9613b7ad-af40-407e-a536-d9008f7138cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.787369 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787250 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmn54\" (UniqueName: \"kubernetes.io/projected/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-kube-api-access-fmn54\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.787369 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9613b7ad-af40-407e-a536-d9008f7138cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bd54d4464-dx49k\" (UID: \"9613b7ad-af40-407e-a536-d9008f7138cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.787369 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-hub\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.787369 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.787369 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.787658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787418 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.787658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-ca\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.787658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/580792c8-24f1-40ef-b217-995893683184-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.787658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsd8z\" (UniqueName: \"kubernetes.io/projected/580792c8-24f1-40ef-b217-995893683184-kube-api-access-jsd8z\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.787658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-tmp\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.787946 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.787924 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-tmp\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.789764 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.789740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.806642 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.806613 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmn54\" (UniqueName: \"kubernetes.io/projected/e0492f2e-48f1-4dcd-ad55-6cfe826c97e6-kube-api-access-fmn54\") pod \"klusterlet-addon-workmgr-7695b45dfc-jckf2\" (UID: \"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.868904 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.868872 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:17.888883 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.888843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsd8z\" (UniqueName: \"kubernetes.io/projected/580792c8-24f1-40ef-b217-995893683184-kube-api-access-jsd8z\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.889071 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.888954 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzpgb\" (UniqueName: \"kubernetes.io/projected/9613b7ad-af40-407e-a536-d9008f7138cd-kube-api-access-bzpgb\") pod \"managed-serviceaccount-addon-agent-7bd54d4464-dx49k\" (UID: \"9613b7ad-af40-407e-a536-d9008f7138cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.889071 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.889063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9613b7ad-af40-407e-a536-d9008f7138cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bd54d4464-dx49k\" (UID: \"9613b7ad-af40-407e-a536-d9008f7138cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.889190 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.889112 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-hub\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.889190 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.889140 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.889638 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.889595 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.889772 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.889694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-ca\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.889772 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.889756 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/580792c8-24f1-40ef-b217-995893683184-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.890473 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.890448 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/580792c8-24f1-40ef-b217-995893683184-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.894981 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.894935 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.894981 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.894935 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9613b7ad-af40-407e-a536-d9008f7138cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bd54d4464-dx49k\" (UID: \"9613b7ad-af40-407e-a536-d9008f7138cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.895373 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.895338 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-hub\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.895846 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.895811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.897105 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.897087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/580792c8-24f1-40ef-b217-995893683184-ca\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.905394 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.904729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsd8z\" (UniqueName: \"kubernetes.io/projected/580792c8-24f1-40ef-b217-995893683184-kube-api-access-jsd8z\") pod \"cluster-proxy-proxy-agent-866957bbf4-7v92k\" (UID: \"580792c8-24f1-40ef-b217-995893683184\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:17.907096 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.907073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzpgb\" (UniqueName: \"kubernetes.io/projected/9613b7ad-af40-407e-a536-d9008f7138cd-kube-api-access-bzpgb\") pod \"managed-serviceaccount-addon-agent-7bd54d4464-dx49k\" (UID: \"9613b7ad-af40-407e-a536-d9008f7138cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.942900 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.942575 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" Jun 02 15:24:17.948044 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:17.947707 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:24:18.078507 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.078479 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2"] Jun 02 15:24:18.081320 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:24:18.081253 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0492f2e_48f1_4dcd_ad55_6cfe826c97e6.slice/crio-880d1dd2557f083cf9c0a2e16a6896709093e29bd914a6b08a20403379cf725f WatchSource:0}: Error finding container 880d1dd2557f083cf9c0a2e16a6896709093e29bd914a6b08a20403379cf725f: Status 404 returned error can't find the container with id 880d1dd2557f083cf9c0a2e16a6896709093e29bd914a6b08a20403379cf725f Jun 02 15:24:18.135081 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.135046 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k"] Jun 02 15:24:18.137980 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:24:18.137950 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod580792c8_24f1_40ef_b217_995893683184.slice/crio-ae118bf2ba7791e545ed2352aee45a10cb4b3897d6ca9b9f4478454652dc2d5a WatchSource:0}: Error finding container ae118bf2ba7791e545ed2352aee45a10cb4b3897d6ca9b9f4478454652dc2d5a: Status 404 returned error can't find the container with id ae118bf2ba7791e545ed2352aee45a10cb4b3897d6ca9b9f4478454652dc2d5a Jun 02 15:24:18.155438 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.155399 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k"] Jun 02 15:24:18.159490 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:24:18.159459 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9613b7ad_af40_407e_a536_d9008f7138cd.slice/crio-bd2dc27c2683ac34d53af81981c31504c8e2323ac9600d13fdba42f93b58208b WatchSource:0}: Error finding container bd2dc27c2683ac34d53af81981c31504c8e2323ac9600d13fdba42f93b58208b: Status 404 returned error can't find the container with id bd2dc27c2683ac34d53af81981c31504c8e2323ac9600d13fdba42f93b58208b Jun 02 15:24:18.700286 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.700244 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" event={"ID":"9613b7ad-af40-407e-a536-d9008f7138cd","Type":"ContainerStarted","Data":"bd2dc27c2683ac34d53af81981c31504c8e2323ac9600d13fdba42f93b58208b"} Jun 02 15:24:18.701414 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.701388 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" event={"ID":"580792c8-24f1-40ef-b217-995893683184","Type":"ContainerStarted","Data":"ae118bf2ba7791e545ed2352aee45a10cb4b3897d6ca9b9f4478454652dc2d5a"} Jun 02 15:24:18.704823 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.704794 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjlst" event={"ID":"4ef844ab-b52b-4d24-b468-d86504f8baee","Type":"ContainerStarted","Data":"cf1f6d201595e76ec2828648d0d397ee913f3f196f506433a6d23e4a9bdab809"} Jun 02 15:24:18.705888 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.705855 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" event={"ID":"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6","Type":"ContainerStarted","Data":"880d1dd2557f083cf9c0a2e16a6896709093e29bd914a6b08a20403379cf725f"} Jun 02 15:24:18.750489 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:18.750427 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vjlst" podStartSLOduration=6.46912134 podStartE2EDuration="43.750408373s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:23:38.457974667 +0000 UTC m=+3.516144977" lastFinishedPulling="2026-06-02 15:24:15.739261706 +0000 UTC m=+40.797432010" observedRunningTime="2026-06-02 15:24:18.749938075 +0000 UTC m=+43.808108401" watchObservedRunningTime="2026-06-02 15:24:18.750408373 +0000 UTC m=+43.808578701" Jun 02 15:24:25.263088 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:25.263041 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:25.263639 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:25.263100 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:25.263639 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.263213 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:25.263639 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.263238 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:25.263639 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.263246 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:25.263639 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.263311 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:41.263292157 +0000 UTC m=+66.321462472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:25.263639 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.263325 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:24:41.263318612 +0000 UTC m=+66.321488915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:25.364602 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:25.364562 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:25.364838 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.364749 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:25.364838 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:25.364821 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:41.364804695 +0000 UTC m=+66.422974998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:27.727113 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.727071 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j82lr" event={"ID":"c6374b65-94c2-4ecd-b144-17c622038c28","Type":"ContainerStarted","Data":"09cc9e0e4963a56656fd2743d1458b83f57b89d7cb8cda600c1b06ecb0092586"} Jun 02 15:24:27.731416 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.731380 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" event={"ID":"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6","Type":"ContainerStarted","Data":"60ac168445c0cfb580ab8dc1e4758c9b7ccc865b0aa54e45206a9815b1e01bc9"} Jun 02 15:24:27.731623 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.731603 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:27.732873 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.732844 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" event={"ID":"9613b7ad-af40-407e-a536-d9008f7138cd","Type":"ContainerStarted","Data":"d9785ae9fd21185c99b4281bd420fc316fd1a95ff5e8efdd3d25b3035c9ff496"} Jun 02 15:24:27.733570 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.733550 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:24:27.734180 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.734160 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" event={"ID":"580792c8-24f1-40ef-b217-995893683184","Type":"ContainerStarted","Data":"15713a5f7a5fa0234e78122a74334d33026451785c5f4bc10f5207b4130e618d"} Jun 02 15:24:27.754590 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.754546 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j82lr" podStartSLOduration=33.791752023 podStartE2EDuration="43.754535248s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:24:17.164177198 +0000 UTC m=+42.222347502" lastFinishedPulling="2026-06-02 15:24:27.12696041 +0000 UTC m=+52.185130727" observedRunningTime="2026-06-02 15:24:27.754485644 +0000 UTC m=+52.812655971" watchObservedRunningTime="2026-06-02 15:24:27.754535248 +0000 UTC m=+52.812705573" Jun 02 15:24:27.780378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:27.780244 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" podStartSLOduration=1.318291623 podStartE2EDuration="10.780231182s" podCreationTimestamp="2026-06-02 15:24:17 +0000 UTC" firstStartedPulling="2026-06-02 15:24:18.083462645 +0000 UTC m=+43.141632952" lastFinishedPulling="2026-06-02 15:24:27.545402204 +0000 UTC m=+52.603572511" observedRunningTime="2026-06-02 15:24:27.778540809 +0000 UTC m=+52.836711136" watchObservedRunningTime="2026-06-02 15:24:27.780231182 +0000 UTC m=+52.838401509" Jun 02 15:24:30.742102 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:30.742066 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" event={"ID":"580792c8-24f1-40ef-b217-995893683184","Type":"ContainerStarted","Data":"883304b46bece5cde894f005b51daa2302738d58464c7e5139ee4134252d3bc8"} Jun 02 15:24:30.742102 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:30.742105 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" event={"ID":"580792c8-24f1-40ef-b217-995893683184","Type":"ContainerStarted","Data":"1791ada6fb277a33be75baf367e65e5c3bc67c68f03051e4a275c569c692ef27"} Jun 02 15:24:30.788857 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:30.788803 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" podStartSLOduration=2.010984782 podStartE2EDuration="13.78878871s" podCreationTimestamp="2026-06-02 15:24:17 +0000 UTC" firstStartedPulling="2026-06-02 15:24:18.139864411 +0000 UTC m=+43.198034721" lastFinishedPulling="2026-06-02 15:24:29.917668342 +0000 UTC m=+54.975838649" observedRunningTime="2026-06-02 15:24:30.788544018 +0000 UTC m=+55.846714344" watchObservedRunningTime="2026-06-02 15:24:30.78878871 +0000 UTC m=+55.846959035" Jun 02 15:24:30.789168 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:30.789147 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" podStartSLOduration=4.817610758 podStartE2EDuration="13.789142937s" podCreationTimestamp="2026-06-02 15:24:17 +0000 UTC" firstStartedPulling="2026-06-02 15:24:18.161587612 +0000 UTC m=+43.219757921" lastFinishedPulling="2026-06-02 15:24:27.133119796 +0000 UTC m=+52.191290100" observedRunningTime="2026-06-02 15:24:27.8055636 +0000 UTC m=+52.863733928" watchObservedRunningTime="2026-06-02 15:24:30.789142937 +0000 UTC m=+55.847313263" Jun 02 15:24:34.672274 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:34.672247 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spfzb" Jun 02 15:24:41.187762 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.187718 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:24:41.191644 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.191625 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:24:41.198754 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.198728 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:24:41.198813 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.198802 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:25:45.198782293 +0000 UTC m=+130.256952605 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : secret "metrics-daemon-secret" not found Jun 02 15:24:41.289117 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.289059 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:41.289308 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.289155 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:24:41.289308 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.289184 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:24:41.289308 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.289295 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:41.289453 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.289387 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:25:13.289367858 +0000 UTC m=+98.347538179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:24:41.289453 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.289297 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:24:41.289453 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.289410 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:24:41.289453 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.289449 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:25:13.289437775 +0000 UTC m=+98.347608083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:24:41.292314 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.292293 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:24:41.302378 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.302338 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:24:41.312133 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.312104 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxnj6\" (UniqueName: \"kubernetes.io/projected/d3f9f513-f3a0-4202-aa2f-89a9a686de62-kube-api-access-fxnj6\") pod \"network-check-target-xdx58\" (UID: \"d3f9f513-f3a0-4202-aa2f-89a9a686de62\") " pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:41.326446 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.326416 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hhkk\"" Jun 02 15:24:41.333247 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.333215 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:41.390245 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.390214 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:24:41.390444 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.390423 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:41.390527 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:24:41.390515 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:25:13.390491321 +0000 UTC m=+98.448661639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:24:41.457507 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.457341 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdx58"] Jun 02 15:24:41.460024 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:24:41.459993 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f9f513_f3a0_4202_aa2f_89a9a686de62.slice/crio-98364caf4f2666f70480ce11bccc7d27e64d0b0ccb5f9e501b506ce030a5af49 WatchSource:0}: Error finding container 98364caf4f2666f70480ce11bccc7d27e64d0b0ccb5f9e501b506ce030a5af49: Status 404 returned error can't find the container with id 98364caf4f2666f70480ce11bccc7d27e64d0b0ccb5f9e501b506ce030a5af49 Jun 02 15:24:41.773582 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:41.773493 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdx58" event={"ID":"d3f9f513-f3a0-4202-aa2f-89a9a686de62","Type":"ContainerStarted","Data":"98364caf4f2666f70480ce11bccc7d27e64d0b0ccb5f9e501b506ce030a5af49"} Jun 02 15:24:44.782947 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:44.782861 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdx58" event={"ID":"d3f9f513-f3a0-4202-aa2f-89a9a686de62","Type":"ContainerStarted","Data":"d7b41b76d76470d010091542e687399a6349e2cc7ceed132101421673e795415"} Jun 02 15:24:44.783373 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:44.782998 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:24:44.808365 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:24:44.808306 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xdx58" podStartSLOduration=66.783629603 podStartE2EDuration="1m9.808291566s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:24:41.46240137 +0000 UTC m=+66.520571674" lastFinishedPulling="2026-06-02 15:24:44.487063333 +0000 UTC m=+69.545233637" observedRunningTime="2026-06-02 15:24:44.807480358 +0000 UTC m=+69.865650685" watchObservedRunningTime="2026-06-02 15:24:44.808291566 +0000 UTC m=+69.866461886" Jun 02 15:25:13.334324 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:25:13.334281 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:25:13.334324 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:25:13.334329 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:25:13.334854 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.334449 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:25:13.334854 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.334468 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d4d4f7f-k2b56: secret "image-registry-tls" not found Jun 02 15:25:13.334854 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.334529 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls podName:c982f2b7-145f-4cd5-8132-bff5e1a3e31c nodeName:}" failed. No retries permitted until 2026-06-02 15:26:17.33451327 +0000 UTC m=+162.392683573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls") pod "image-registry-7d8d4d4f7f-k2b56" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c") : secret "image-registry-tls" not found Jun 02 15:25:13.334854 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.334596 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:25:13.334854 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.334672 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert podName:8a40dda6-f5c5-4748-9156-584008e60fd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:17.334656687 +0000 UTC m=+162.392827005 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert") pod "ingress-canary-6s6sk" (UID: "8a40dda6-f5c5-4748-9156-584008e60fd9") : secret "canary-serving-cert" not found Jun 02 15:25:13.435387 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:25:13.435322 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:25:13.435583 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.435482 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:25:13.435583 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:13.435559 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls podName:36e443ce-99da-4941-b80d-9da759ccd7c6 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:17.435540223 +0000 UTC m=+162.493710545 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls") pod "dns-default-4c65x" (UID: "36e443ce-99da-4941-b80d-9da759ccd7c6") : secret "dns-default-metrics-tls" not found Jun 02 15:25:15.787764 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:25:15.787733 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xdx58" Jun 02 15:25:45.263831 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:25:45.263776 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:25:45.264317 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:45.263920 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:25:45.264317 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:25:45.263984 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs podName:092e0688-c9d4-4abf-aa2e-f41656eca37d nodeName:}" failed. No retries permitted until 2026-06-02 15:27:47.26396882 +0000 UTC m=+252.322139124 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs") pod "network-metrics-daemon-bzvdk" (UID: "092e0688-c9d4-4abf-aa2e-f41656eca37d") : secret "metrics-daemon-secret" not found Jun 02 15:26:08.359791 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:08.359762 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-25mpd_223c4307-56a0-493b-a586-91711c510cae/dns-node-resolver/0.log" Jun 02 15:26:09.558758 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:09.558731 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gsk6p_dfc25338-688b-4fa6-8c24-336aae6fdc53/node-ca/0.log" Jun 02 15:26:12.350233 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:26:12.350190 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" Jun 02 15:26:12.397574 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:26:12.397525 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6s6sk" podUID="8a40dda6-f5c5-4748-9156-584008e60fd9" Jun 02 15:26:12.506574 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:26:12.506530 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4c65x" podUID="36e443ce-99da-4941-b80d-9da759ccd7c6" Jun 02 15:26:12.516673 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:26:12.516643 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bzvdk" podUID="092e0688-c9d4-4abf-aa2e-f41656eca37d" Jun 02 15:26:12.989170 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:12.989144 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:26:12.989303 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:12.989258 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4c65x" Jun 02 15:26:12.989393 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:12.989373 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:26:17.409615 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.409570 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:26:17.409615 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.409620 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:26:17.412002 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.411973 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a40dda6-f5c5-4748-9156-584008e60fd9-cert\") pod \"ingress-canary-6s6sk\" (UID: \"8a40dda6-f5c5-4748-9156-584008e60fd9\") " pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:26:17.412002 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.411997 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"image-registry-7d8d4d4f7f-k2b56\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:26:17.493889 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.493857 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb47d\"" Jun 02 15:26:17.493889 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.493856 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kbhxp\"" Jun 02 15:26:17.500293 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.500269 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s6sk" Jun 02 15:26:17.500391 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.500375 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:26:17.510403 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.510378 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:26:17.513368 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.513327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36e443ce-99da-4941-b80d-9da759ccd7c6-metrics-tls\") pod \"dns-default-4c65x\" (UID: \"36e443ce-99da-4941-b80d-9da759ccd7c6\") " pod="openshift-dns/dns-default-4c65x" Jun 02 15:26:17.654045 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.654016 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6s6sk"] Jun 02 15:26:17.656649 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:26:17.656622 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a40dda6_f5c5_4748_9156_584008e60fd9.slice/crio-0a01dbb8ee36f6caf517626dd5cf01301d6f2a28c4d160900f7034946fe262ff WatchSource:0}: Error finding container 0a01dbb8ee36f6caf517626dd5cf01301d6f2a28c4d160900f7034946fe262ff: Status 404 returned error can't find the container with id 0a01dbb8ee36f6caf517626dd5cf01301d6f2a28c4d160900f7034946fe262ff Jun 02 15:26:17.673864 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.673838 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8d4d4f7f-k2b56"] Jun 02 15:26:17.676701 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:26:17.676671 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc982f2b7_145f_4cd5_8132_bff5e1a3e31c.slice/crio-1fe0714904d63362ca18290c9c892d19e11f13c2d445fdb6337ebff2c90cd4ed WatchSource:0}: Error finding container 1fe0714904d63362ca18290c9c892d19e11f13c2d445fdb6337ebff2c90cd4ed: Status 404 returned error can't find the container with id 1fe0714904d63362ca18290c9c892d19e11f13c2d445fdb6337ebff2c90cd4ed Jun 02 15:26:17.792771 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.792740 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqlt7\"" Jun 02 15:26:17.800242 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.800216 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4c65x" Jun 02 15:26:17.927054 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:17.927029 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4c65x"] Jun 02 15:26:17.929277 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:26:17.929251 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e443ce_99da_4941_b80d_9da759ccd7c6.slice/crio-2e25fda00f09d43dbf5c7383edac6d777fe46a7fedda4447f96cc6c0cf33bb25 WatchSource:0}: Error finding container 2e25fda00f09d43dbf5c7383edac6d777fe46a7fedda4447f96cc6c0cf33bb25: Status 404 returned error can't find the container with id 2e25fda00f09d43dbf5c7383edac6d777fe46a7fedda4447f96cc6c0cf33bb25 Jun 02 15:26:18.002866 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:18.002824 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4c65x" event={"ID":"36e443ce-99da-4941-b80d-9da759ccd7c6","Type":"ContainerStarted","Data":"2e25fda00f09d43dbf5c7383edac6d777fe46a7fedda4447f96cc6c0cf33bb25"} Jun 02 15:26:18.004193 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:18.004161 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" event={"ID":"c982f2b7-145f-4cd5-8132-bff5e1a3e31c","Type":"ContainerStarted","Data":"448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1"} Jun 02 15:26:18.004326 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:18.004198 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" event={"ID":"c982f2b7-145f-4cd5-8132-bff5e1a3e31c","Type":"ContainerStarted","Data":"1fe0714904d63362ca18290c9c892d19e11f13c2d445fdb6337ebff2c90cd4ed"} Jun 02 15:26:18.004326 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:18.004292 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:26:18.005105 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:18.005082 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6s6sk" event={"ID":"8a40dda6-f5c5-4748-9156-584008e60fd9","Type":"ContainerStarted","Data":"0a01dbb8ee36f6caf517626dd5cf01301d6f2a28c4d160900f7034946fe262ff"} Jun 02 15:26:18.046914 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:18.046856 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" podStartSLOduration=162.0468359 podStartE2EDuration="2m42.0468359s" podCreationTimestamp="2026-06-02 15:23:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:18.046247271 +0000 UTC m=+163.104417599" watchObservedRunningTime="2026-06-02 15:26:18.0468359 +0000 UTC m=+163.105006227" Jun 02 15:26:21.014877 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:21.014839 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6s6sk" event={"ID":"8a40dda6-f5c5-4748-9156-584008e60fd9","Type":"ContainerStarted","Data":"aa50c051498b402ca284e1098828a745de32d2b17078aae046b07c3df2ad08fe"} Jun 02 15:26:21.016302 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:21.016273 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4c65x" event={"ID":"36e443ce-99da-4941-b80d-9da759ccd7c6","Type":"ContainerStarted","Data":"571c17c7de3825d416fb8d92af0ac22714070190c916a51f8731d9cb127fcd4b"} Jun 02 15:26:21.016302 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:21.016304 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4c65x" event={"ID":"36e443ce-99da-4941-b80d-9da759ccd7c6","Type":"ContainerStarted","Data":"6ae352831147a9d6bcd2d60f7192d7f752cf4696e799940c6a592ce4518c1219"} Jun 02 15:26:21.016508 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:21.016386 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4c65x" Jun 02 15:26:21.035033 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:21.034980 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6s6sk" podStartSLOduration=129.307268739 podStartE2EDuration="2m12.034966694s" podCreationTimestamp="2026-06-02 15:24:09 +0000 UTC" firstStartedPulling="2026-06-02 15:26:17.658303465 +0000 UTC m=+162.716473770" lastFinishedPulling="2026-06-02 15:26:20.386001418 +0000 UTC m=+165.444171725" observedRunningTime="2026-06-02 15:26:21.034558692 +0000 UTC m=+166.092729020" watchObservedRunningTime="2026-06-02 15:26:21.034966694 +0000 UTC m=+166.093137020" Jun 02 15:26:21.052819 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:21.052772 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4c65x" podStartSLOduration=129.600932216 podStartE2EDuration="2m12.052759688s" podCreationTimestamp="2026-06-02 15:24:09 +0000 UTC" firstStartedPulling="2026-06-02 15:26:17.931047897 +0000 UTC m=+162.989218205" lastFinishedPulling="2026-06-02 15:26:20.38287537 +0000 UTC m=+165.441045677" observedRunningTime="2026-06-02 15:26:21.051940658 +0000 UTC m=+166.110110984" watchObservedRunningTime="2026-06-02 15:26:21.052759688 +0000 UTC m=+166.110930013" Jun 02 15:26:25.484811 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:25.484725 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:26:27.732759 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:27.732708 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" podUID="e0492f2e-48f1-4dcd-ad55-6cfe826c97e6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 02 15:26:27.870035 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:27.869990 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" podUID="e0492f2e-48f1-4dcd-ad55-6cfe826c97e6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/healthz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 02 15:26:27.944118 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:27.944018 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" podUID="9613b7ad-af40-407e-a536-d9008f7138cd" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/healthz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jun 02 15:26:28.032923 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:28.032891 2555 generic.go:358] "Generic (PLEG): container finished" podID="e0492f2e-48f1-4dcd-ad55-6cfe826c97e6" containerID="60ac168445c0cfb580ab8dc1e4758c9b7ccc865b0aa54e45206a9815b1e01bc9" exitCode=1 Jun 02 15:26:28.033096 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:28.032966 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" event={"ID":"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6","Type":"ContainerDied","Data":"60ac168445c0cfb580ab8dc1e4758c9b7ccc865b0aa54e45206a9815b1e01bc9"} Jun 02 15:26:28.033363 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:28.033327 2555 scope.go:117] "RemoveContainer" containerID="60ac168445c0cfb580ab8dc1e4758c9b7ccc865b0aa54e45206a9815b1e01bc9" Jun 02 15:26:28.034171 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:28.034149 2555 generic.go:358] "Generic (PLEG): container finished" podID="9613b7ad-af40-407e-a536-d9008f7138cd" containerID="d9785ae9fd21185c99b4281bd420fc316fd1a95ff5e8efdd3d25b3035c9ff496" exitCode=255 Jun 02 15:26:28.034258 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:28.034183 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" event={"ID":"9613b7ad-af40-407e-a536-d9008f7138cd","Type":"ContainerDied","Data":"d9785ae9fd21185c99b4281bd420fc316fd1a95ff5e8efdd3d25b3035c9ff496"} Jun 02 15:26:28.034552 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:28.034513 2555 scope.go:117] "RemoveContainer" containerID="d9785ae9fd21185c99b4281bd420fc316fd1a95ff5e8efdd3d25b3035c9ff496" Jun 02 15:26:29.040923 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:29.040887 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" event={"ID":"e0492f2e-48f1-4dcd-ad55-6cfe826c97e6","Type":"ContainerStarted","Data":"967ae34fea76e901bb85342adbe3834491f3b8b2ad1fcaf8b8292f591658a839"} Jun 02 15:26:29.041392 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:29.041211 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:26:29.042249 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:29.042230 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7695b45dfc-jckf2" Jun 02 15:26:29.042752 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:29.042730 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd54d4464-dx49k" event={"ID":"9613b7ad-af40-407e-a536-d9008f7138cd","Type":"ContainerStarted","Data":"51056dc3e0397ec9ffa92c0bf595100f6e9b08e3081e6a4a9e456c523fd76d66"} Jun 02 15:26:31.020943 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:31.020913 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4c65x" Jun 02 15:26:37.504621 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.504588 2555 patch_prober.go:28] interesting pod/image-registry-7d8d4d4f7f-k2b56 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 15:26:37.504993 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.504648 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:26:37.804341 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.804267 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-895kp"] Jun 02 15:26:37.807557 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.807531 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:37.817483 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:26:37.817457 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-140-163.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 02 15:26:37.828913 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.828893 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 15:26:37.829467 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.829454 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 15:26:37.830047 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.830032 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nv42j\"" Jun 02 15:26:37.840198 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.840182 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 15:26:37.868005 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.867978 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-895kp"] Jun 02 15:26:37.949165 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.949130 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" podUID="580792c8-24f1-40ef-b217-995893683184" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 15:26:37.967911 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.967881 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvbk\" (UniqueName: \"kubernetes.io/projected/f13e7b81-1823-46b7-a317-4725f9676f12-kube-api-access-7mvbk\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:37.968069 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.967923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13e7b81-1823-46b7-a317-4725f9676f12-data-volume\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:37.968069 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.967989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13e7b81-1823-46b7-a317-4725f9676f12-crio-socket\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:37.968069 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.968007 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13e7b81-1823-46b7-a317-4725f9676f12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:37.968069 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:37.968047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13e7b81-1823-46b7-a317-4725f9676f12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069213 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069128 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13e7b81-1823-46b7-a317-4725f9676f12-crio-socket\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069213 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069162 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13e7b81-1823-46b7-a317-4725f9676f12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069213 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069189 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13e7b81-1823-46b7-a317-4725f9676f12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069537 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069254 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvbk\" (UniqueName: \"kubernetes.io/projected/f13e7b81-1823-46b7-a317-4725f9676f12-kube-api-access-7mvbk\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069537 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069260 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13e7b81-1823-46b7-a317-4725f9676f12-crio-socket\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069537 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069317 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13e7b81-1823-46b7-a317-4725f9676f12-data-volume\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.069644 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.069623 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13e7b81-1823-46b7-a317-4725f9676f12-data-volume\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.071522 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.071505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13e7b81-1823-46b7-a317-4725f9676f12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:38.082984 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:38.082963 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvbk\" (UniqueName: \"kubernetes.io/projected/f13e7b81-1823-46b7-a317-4725f9676f12-kube-api-access-7mvbk\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:39.013112 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:39.013082 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:26:39.044817 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:39.044788 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 15:26:39.050696 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:39.050667 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13e7b81-1823-46b7-a317-4725f9676f12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-895kp\" (UID: \"f13e7b81-1823-46b7-a317-4725f9676f12\") " pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:39.316582 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:39.316482 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-895kp" Jun 02 15:26:39.441956 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:39.441926 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-895kp"] Jun 02 15:26:39.444781 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:26:39.444755 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13e7b81_1823_46b7_a317_4725f9676f12.slice/crio-a872777ccbf77ee7c04db2477ea3961fb7a1105b48a000989c9f17d71a26642a WatchSource:0}: Error finding container a872777ccbf77ee7c04db2477ea3961fb7a1105b48a000989c9f17d71a26642a: Status 404 returned error can't find the container with id a872777ccbf77ee7c04db2477ea3961fb7a1105b48a000989c9f17d71a26642a Jun 02 15:26:40.072627 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:40.072588 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-895kp" event={"ID":"f13e7b81-1823-46b7-a317-4725f9676f12","Type":"ContainerStarted","Data":"2ecd05cf5182612f34421e83a76897340b8ba31386a32766e98fc808fe7805d3"} Jun 02 15:26:40.072627 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:40.072629 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-895kp" event={"ID":"f13e7b81-1823-46b7-a317-4725f9676f12","Type":"ContainerStarted","Data":"a872777ccbf77ee7c04db2477ea3961fb7a1105b48a000989c9f17d71a26642a"} Jun 02 15:26:41.077034 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:41.076995 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-895kp" event={"ID":"f13e7b81-1823-46b7-a317-4725f9676f12","Type":"ContainerStarted","Data":"db4cb4477ae0a607179f670d653199b6ceaaefb9f1fb181d86b902f9bfb4e528"} Jun 02 15:26:42.081593 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:42.081559 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-895kp" event={"ID":"f13e7b81-1823-46b7-a317-4725f9676f12","Type":"ContainerStarted","Data":"a0c205a3a77aef7a36acf3f4e2299dd1755cc72d68c4d2c973643ee8b9f454b5"} Jun 02 15:26:42.121572 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:42.121524 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-895kp" podStartSLOduration=3.13759965 podStartE2EDuration="5.121510028s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:39.512121612 +0000 UTC m=+184.570291916" lastFinishedPulling="2026-06-02 15:26:41.496031979 +0000 UTC m=+186.554202294" observedRunningTime="2026-06-02 15:26:42.119214387 +0000 UTC m=+187.177384715" watchObservedRunningTime="2026-06-02 15:26:42.121510028 +0000 UTC m=+187.179680353" Jun 02 15:26:47.948758 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:47.948711 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" podUID="580792c8-24f1-40ef-b217-995893683184" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 15:26:48.279840 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.279763 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-shfzx"] Jun 02 15:26:48.282968 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.282947 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.294223 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.294202 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 15:26:48.294642 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.294614 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 15:26:48.294761 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.294693 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xvk85\"" Jun 02 15:26:48.294878 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.294793 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 15:26:48.295195 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.295181 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 15:26:48.295550 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.295538 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 15:26:48.298384 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.298369 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 15:26:48.442211 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442170 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-sys\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442405 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xmj\" (UniqueName: \"kubernetes.io/projected/72592af6-da49-4316-ba1b-a19d2abf1070-kube-api-access-f2xmj\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442405 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72592af6-da49-4316-ba1b-a19d2abf1070-metrics-client-ca\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442405 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442405 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-root\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442405 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-accelerators-collector-config\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442575 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442423 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-tls\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442575 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442472 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-textfile\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.442575 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.442503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-wtmp\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543636 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543539 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-sys\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543636 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543602 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xmj\" (UniqueName: \"kubernetes.io/projected/72592af6-da49-4316-ba1b-a19d2abf1070-kube-api-access-f2xmj\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543653 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72592af6-da49-4316-ba1b-a19d2abf1070-metrics-client-ca\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-sys\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543683 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543725 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-root\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543749 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-accelerators-collector-config\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543775 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-tls\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543800 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-textfile\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.543843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.543831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-wtmp\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.544250 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.544000 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-wtmp\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.544250 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.544007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72592af6-da49-4316-ba1b-a19d2abf1070-root\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.544250 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.544182 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-textfile\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.544435 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.544331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72592af6-da49-4316-ba1b-a19d2abf1070-metrics-client-ca\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.544490 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.544428 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-accelerators-collector-config\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.546033 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.546014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-tls\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.546123 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.546075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72592af6-da49-4316-ba1b-a19d2abf1070-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.580583 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.580548 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xmj\" (UniqueName: \"kubernetes.io/projected/72592af6-da49-4316-ba1b-a19d2abf1070-kube-api-access-f2xmj\") pod \"node-exporter-shfzx\" (UID: \"72592af6-da49-4316-ba1b-a19d2abf1070\") " pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.591163 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:48.591127 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-shfzx" Jun 02 15:26:48.601068 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:26:48.601040 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72592af6_da49_4316_ba1b_a19d2abf1070.slice/crio-797b51c826ad57c5b7bcfa5dd452d8dd2406cfbeace6bdd5af2313e3b952e6bd WatchSource:0}: Error finding container 797b51c826ad57c5b7bcfa5dd452d8dd2406cfbeace6bdd5af2313e3b952e6bd: Status 404 returned error can't find the container with id 797b51c826ad57c5b7bcfa5dd452d8dd2406cfbeace6bdd5af2313e3b952e6bd Jun 02 15:26:49.098571 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:49.098532 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shfzx" event={"ID":"72592af6-da49-4316-ba1b-a19d2abf1070","Type":"ContainerStarted","Data":"797b51c826ad57c5b7bcfa5dd452d8dd2406cfbeace6bdd5af2313e3b952e6bd"} Jun 02 15:26:50.102736 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:50.102702 2555 generic.go:358] "Generic (PLEG): container finished" podID="72592af6-da49-4316-ba1b-a19d2abf1070" containerID="41319b71da3430fef14cd0a8e2559649c0945f03a01f95c2f52fe59d5482f75b" exitCode=0 Jun 02 15:26:50.103123 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:50.102747 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shfzx" event={"ID":"72592af6-da49-4316-ba1b-a19d2abf1070","Type":"ContainerDied","Data":"41319b71da3430fef14cd0a8e2559649c0945f03a01f95c2f52fe59d5482f75b"} Jun 02 15:26:51.107787 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:51.107748 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shfzx" event={"ID":"72592af6-da49-4316-ba1b-a19d2abf1070","Type":"ContainerStarted","Data":"674b43f879e72f97da7624089a0a205aaf718b1ff02b4614a771ad271773f0ed"} Jun 02 15:26:51.107787 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:51.107785 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shfzx" event={"ID":"72592af6-da49-4316-ba1b-a19d2abf1070","Type":"ContainerStarted","Data":"8002b969fe84132168bdbbd72793da3d4e6311bfbf67dccb0251c232d25a316d"} Jun 02 15:26:57.949279 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:57.949234 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" podUID="580792c8-24f1-40ef-b217-995893683184" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 15:26:57.949730 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:57.949307 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" Jun 02 15:26:57.949800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:57.949768 2555 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"883304b46bece5cde894f005b51daa2302738d58464c7e5139ee4134252d3bc8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 15:26:57.949836 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:57.949819 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" podUID="580792c8-24f1-40ef-b217-995893683184" containerName="service-proxy" containerID="cri-o://883304b46bece5cde894f005b51daa2302738d58464c7e5139ee4134252d3bc8" gracePeriod=30 Jun 02 15:26:58.130549 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:58.130518 2555 generic.go:358] "Generic (PLEG): container finished" podID="580792c8-24f1-40ef-b217-995893683184" containerID="883304b46bece5cde894f005b51daa2302738d58464c7e5139ee4134252d3bc8" exitCode=2 Jun 02 15:26:58.130697 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:58.130591 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" event={"ID":"580792c8-24f1-40ef-b217-995893683184","Type":"ContainerDied","Data":"883304b46bece5cde894f005b51daa2302738d58464c7e5139ee4134252d3bc8"} Jun 02 15:26:58.130697 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:58.130633 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866957bbf4-7v92k" event={"ID":"580792c8-24f1-40ef-b217-995893683184","Type":"ContainerStarted","Data":"23f0971110a15d5f61778bff1269729d3a58480c28a04b8587b82637ecdce63c"} Jun 02 15:26:58.162178 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:26:58.162124 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-shfzx" podStartSLOduration=9.148016186 podStartE2EDuration="10.162111849s" podCreationTimestamp="2026-06-02 15:26:48 +0000 UTC" firstStartedPulling="2026-06-02 15:26:48.603228886 +0000 UTC m=+193.661399209" lastFinishedPulling="2026-06-02 15:26:49.617324565 +0000 UTC m=+194.675494872" observedRunningTime="2026-06-02 15:26:51.132289201 +0000 UTC m=+196.190459526" watchObservedRunningTime="2026-06-02 15:26:58.162111849 +0000 UTC m=+203.220282175" Jun 02 15:27:00.142455 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:00.142423 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8d4d4f7f-k2b56"] Jun 02 15:27:25.161871 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.161806 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" containerName="registry" containerID="cri-o://448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1" gracePeriod=30 Jun 02 15:27:25.397503 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.397479 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:27:25.508179 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508090 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-ca-trust-extracted\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508179 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508131 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508179 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508153 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-certificates\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508487 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508189 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-installation-pull-secrets\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508487 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508233 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crxdz\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-kube-api-access-crxdz\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508487 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508247 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-bound-sa-token\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508487 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508268 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-image-registry-private-configuration\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508487 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508291 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-trusted-ca\") pod \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\" (UID: \"c982f2b7-145f-4cd5-8132-bff5e1a3e31c\") " Jun 02 15:27:25.508902 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508862 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:25.509080 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.508914 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:25.510846 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.510785 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:25.510963 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.510884 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:25.511029 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.511003 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-kube-api-access-crxdz" (OuterVolumeSpecName: "kube-api-access-crxdz") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "kube-api-access-crxdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:25.511076 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.511032 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:25.511230 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.511200 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:25.517098 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.517077 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c982f2b7-145f-4cd5-8132-bff5e1a3e31c" (UID: "c982f2b7-145f-4cd5-8132-bff5e1a3e31c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:27:25.609305 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609255 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crxdz\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-kube-api-access-crxdz\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609305 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609301 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-bound-sa-token\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609305 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609311 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-image-registry-private-configuration\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609305 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609321 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-trusted-ca\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609331 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-ca-trust-extracted\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609340 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-tls\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609366 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-registry-certificates\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:25.609551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:25.609375 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c982f2b7-145f-4cd5-8132-bff5e1a3e31c-installation-pull-secrets\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:27:26.204408 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.204375 2555 generic.go:358] "Generic (PLEG): container finished" podID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" containerID="448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1" exitCode=0 Jun 02 15:27:26.204813 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.204478 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" event={"ID":"c982f2b7-145f-4cd5-8132-bff5e1a3e31c","Type":"ContainerDied","Data":"448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1"} Jun 02 15:27:26.204813 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.204495 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" Jun 02 15:27:26.204813 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.204507 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d4d4f7f-k2b56" event={"ID":"c982f2b7-145f-4cd5-8132-bff5e1a3e31c","Type":"ContainerDied","Data":"1fe0714904d63362ca18290c9c892d19e11f13c2d445fdb6337ebff2c90cd4ed"} Jun 02 15:27:26.204813 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.204530 2555 scope.go:117] "RemoveContainer" containerID="448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1" Jun 02 15:27:26.212304 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.212287 2555 scope.go:117] "RemoveContainer" containerID="448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1" Jun 02 15:27:26.212612 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:27:26.212594 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1\": container with ID starting with 448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1 not found: ID does not exist" containerID="448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1" Jun 02 15:27:26.212665 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.212620 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1"} err="failed to get container status \"448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1\": rpc error: code = NotFound desc = could not find container \"448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1\": container with ID starting with 448909d9974453c5c2d0da215a5de5045a42a5564bb89990d71c09cd248904e1 not found: ID does not exist" Jun 02 15:27:26.230498 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.230468 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8d4d4f7f-k2b56"] Jun 02 15:27:26.241685 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:26.241659 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d8d4d4f7f-k2b56"] Jun 02 15:27:27.488398 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:27.488336 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" path="/var/lib/kubelet/pods/c982f2b7-145f-4cd5-8132-bff5e1a3e31c/volumes" Jun 02 15:27:47.275238 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:47.275196 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:27:47.277633 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:47.277607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/092e0688-c9d4-4abf-aa2e-f41656eca37d-metrics-certs\") pod \"network-metrics-daemon-bzvdk\" (UID: \"092e0688-c9d4-4abf-aa2e-f41656eca37d\") " pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:27:47.389002 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:47.388970 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8csp4\"" Jun 02 15:27:47.396572 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:47.396549 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzvdk" Jun 02 15:27:47.517109 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:47.517073 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bzvdk"] Jun 02 15:27:47.520077 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:27:47.520044 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092e0688_c9d4_4abf_aa2e_f41656eca37d.slice/crio-2fccf3f5abe410c97229af6d1dfa1431afe5d2234b352e9f0001b52eaa4e650e WatchSource:0}: Error finding container 2fccf3f5abe410c97229af6d1dfa1431afe5d2234b352e9f0001b52eaa4e650e: Status 404 returned error can't find the container with id 2fccf3f5abe410c97229af6d1dfa1431afe5d2234b352e9f0001b52eaa4e650e Jun 02 15:27:48.262566 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:48.262525 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzvdk" event={"ID":"092e0688-c9d4-4abf-aa2e-f41656eca37d","Type":"ContainerStarted","Data":"2fccf3f5abe410c97229af6d1dfa1431afe5d2234b352e9f0001b52eaa4e650e"} Jun 02 15:27:49.267134 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:49.267096 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzvdk" event={"ID":"092e0688-c9d4-4abf-aa2e-f41656eca37d","Type":"ContainerStarted","Data":"8d24bb0d83cc9035ce553e6ec4b8f18af6526b54119943613697de7ee6b4c4a6"} Jun 02 15:27:49.267542 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:49.267141 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzvdk" event={"ID":"092e0688-c9d4-4abf-aa2e-f41656eca37d","Type":"ContainerStarted","Data":"7d1d0c03bba1833aec27cb401cdedd026fe726caba88ad47221ee9adef33f7c4"} Jun 02 15:27:49.287484 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:27:49.287427 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bzvdk" podStartSLOduration=253.212927463 podStartE2EDuration="4m14.287408566s" podCreationTimestamp="2026-06-02 15:23:35 +0000 UTC" firstStartedPulling="2026-06-02 15:27:47.521853984 +0000 UTC m=+252.580024294" lastFinishedPulling="2026-06-02 15:27:48.596335082 +0000 UTC m=+253.654505397" observedRunningTime="2026-06-02 15:27:49.286147232 +0000 UTC m=+254.344317574" watchObservedRunningTime="2026-06-02 15:27:49.287408566 +0000 UTC m=+254.345578894" Jun 02 15:28:35.372078 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:28:35.372050 2555 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 15:32:57.287954 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.287918 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5966s"] Jun 02 15:32:57.288453 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.288162 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" containerName="registry" Jun 02 15:32:57.288453 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.288174 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" containerName="registry" Jun 02 15:32:57.288453 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.288222 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="c982f2b7-145f-4cd5-8132-bff5e1a3e31c" containerName="registry" Jun 02 15:32:57.290780 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.290763 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.294391 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.294370 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 15:32:57.294391 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.294384 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5b9sh\"" Jun 02 15:32:57.295185 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.295159 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 15:32:57.307390 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.307369 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5966s"] Jun 02 15:32:57.380909 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.380877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a2b43fe-f314-44a4-9926-134559b31452-bound-sa-token\") pod \"cert-manager-79c8d999ff-5966s\" (UID: \"8a2b43fe-f314-44a4-9926-134559b31452\") " pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.381083 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.380957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzgn9\" (UniqueName: \"kubernetes.io/projected/8a2b43fe-f314-44a4-9926-134559b31452-kube-api-access-zzgn9\") pod \"cert-manager-79c8d999ff-5966s\" (UID: \"8a2b43fe-f314-44a4-9926-134559b31452\") " pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.482058 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.482023 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzgn9\" (UniqueName: \"kubernetes.io/projected/8a2b43fe-f314-44a4-9926-134559b31452-kube-api-access-zzgn9\") pod \"cert-manager-79c8d999ff-5966s\" (UID: \"8a2b43fe-f314-44a4-9926-134559b31452\") " pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.482058 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.482063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a2b43fe-f314-44a4-9926-134559b31452-bound-sa-token\") pod \"cert-manager-79c8d999ff-5966s\" (UID: \"8a2b43fe-f314-44a4-9926-134559b31452\") " pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.492833 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.492798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a2b43fe-f314-44a4-9926-134559b31452-bound-sa-token\") pod \"cert-manager-79c8d999ff-5966s\" (UID: \"8a2b43fe-f314-44a4-9926-134559b31452\") " pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.492981 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.492945 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzgn9\" (UniqueName: \"kubernetes.io/projected/8a2b43fe-f314-44a4-9926-134559b31452-kube-api-access-zzgn9\") pod \"cert-manager-79c8d999ff-5966s\" (UID: \"8a2b43fe-f314-44a4-9926-134559b31452\") " pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.599243 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.599182 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5966s" Jun 02 15:32:57.721201 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.721173 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5966s"] Jun 02 15:32:57.723785 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:32:57.723758 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a2b43fe_f314_44a4_9926_134559b31452.slice/crio-4665c2cb57e226d801014420aa894e978a29f5a76c35ef4349fce345d73f53f2 WatchSource:0}: Error finding container 4665c2cb57e226d801014420aa894e978a29f5a76c35ef4349fce345d73f53f2: Status 404 returned error can't find the container with id 4665c2cb57e226d801014420aa894e978a29f5a76c35ef4349fce345d73f53f2 Jun 02 15:32:57.726048 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:57.726028 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:32:58.022681 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:32:58.022599 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5966s" event={"ID":"8a2b43fe-f314-44a4-9926-134559b31452","Type":"ContainerStarted","Data":"4665c2cb57e226d801014420aa894e978a29f5a76c35ef4349fce345d73f53f2"} Jun 02 15:33:03.037696 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:03.037655 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5966s" event={"ID":"8a2b43fe-f314-44a4-9926-134559b31452","Type":"ContainerStarted","Data":"527be7713c02e8e3adda347b17124a56316d926c64cc4c083fde469f3331941a"} Jun 02 15:33:03.064305 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:03.064245 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5966s" podStartSLOduration=1.334343909 podStartE2EDuration="6.064230713s" podCreationTimestamp="2026-06-02 15:32:57 +0000 UTC" firstStartedPulling="2026-06-02 15:32:57.726184848 +0000 UTC m=+562.784355152" lastFinishedPulling="2026-06-02 15:33:02.456071651 +0000 UTC m=+567.514241956" observedRunningTime="2026-06-02 15:33:03.06299669 +0000 UTC m=+568.121167017" watchObservedRunningTime="2026-06-02 15:33:03.064230713 +0000 UTC m=+568.122401039" Jun 02 15:33:19.872993 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.872951 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf"] Jun 02 15:33:19.877827 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.877808 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:19.880799 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.880775 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 15:33:19.880940 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.880889 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 15:33:19.880940 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.880912 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 15:33:19.880940 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.880914 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wtvxv\"" Jun 02 15:33:19.881110 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.880989 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 15:33:19.911311 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.911278 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf"] Jun 02 15:33:19.935890 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.935850 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cffc48eb-7911-4d83-a69e-77ae13daf414-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:19.936063 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.935917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cffc48eb-7911-4d83-a69e-77ae13daf414-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:19.936063 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.935976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cffc48eb-7911-4d83-a69e-77ae13daf414-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:19.936063 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.936002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnzqb\" (UniqueName: \"kubernetes.io/projected/cffc48eb-7911-4d83-a69e-77ae13daf414-kube-api-access-hnzqb\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:19.936063 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:19.936036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cffc48eb-7911-4d83-a69e-77ae13daf414-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.037173 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.037122 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cffc48eb-7911-4d83-a69e-77ae13daf414-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.037173 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.037178 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cffc48eb-7911-4d83-a69e-77ae13daf414-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.037515 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.037207 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnzqb\" (UniqueName: \"kubernetes.io/projected/cffc48eb-7911-4d83-a69e-77ae13daf414-kube-api-access-hnzqb\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.037515 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.037242 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cffc48eb-7911-4d83-a69e-77ae13daf414-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.037515 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.037287 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cffc48eb-7911-4d83-a69e-77ae13daf414-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.037728 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.037697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cffc48eb-7911-4d83-a69e-77ae13daf414-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.039662 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.039638 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cffc48eb-7911-4d83-a69e-77ae13daf414-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.039773 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.039755 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cffc48eb-7911-4d83-a69e-77ae13daf414-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.039831 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.039775 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cffc48eb-7911-4d83-a69e-77ae13daf414-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.055792 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.055753 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnzqb\" (UniqueName: \"kubernetes.io/projected/cffc48eb-7911-4d83-a69e-77ae13daf414-kube-api-access-hnzqb\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf\" (UID: \"cffc48eb-7911-4d83-a69e-77ae13daf414\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.187545 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.187454 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:20.388255 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:20.388228 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf"] Jun 02 15:33:20.389972 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:33:20.389947 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffc48eb_7911_4d83_a69e_77ae13daf414.slice/crio-2efc4f9c83e5a5b0f59997f70fc0fd810c198f39787467c07aea454060f0558a WatchSource:0}: Error finding container 2efc4f9c83e5a5b0f59997f70fc0fd810c198f39787467c07aea454060f0558a: Status 404 returned error can't find the container with id 2efc4f9c83e5a5b0f59997f70fc0fd810c198f39787467c07aea454060f0558a Jun 02 15:33:21.088307 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:21.088265 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" event={"ID":"cffc48eb-7911-4d83-a69e-77ae13daf414","Type":"ContainerStarted","Data":"2efc4f9c83e5a5b0f59997f70fc0fd810c198f39787467c07aea454060f0558a"} Jun 02 15:33:24.099101 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:24.099059 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" event={"ID":"cffc48eb-7911-4d83-a69e-77ae13daf414","Type":"ContainerStarted","Data":"72ed5899ed1f9861bab2712d449eb281457751588277a00be80b93caaf910fad"} Jun 02 15:33:25.102771 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:25.102738 2555 generic.go:358] "Generic (PLEG): container finished" podID="cffc48eb-7911-4d83-a69e-77ae13daf414" containerID="72ed5899ed1f9861bab2712d449eb281457751588277a00be80b93caaf910fad" exitCode=0 Jun 02 15:33:25.102771 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:25.102775 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" event={"ID":"cffc48eb-7911-4d83-a69e-77ae13daf414","Type":"ContainerDied","Data":"72ed5899ed1f9861bab2712d449eb281457751588277a00be80b93caaf910fad"} Jun 02 15:33:26.106899 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:26.106858 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" event={"ID":"cffc48eb-7911-4d83-a69e-77ae13daf414","Type":"ContainerStarted","Data":"28de9128c808c21db4507df5c4a5a1b597c71adc49d8d8935aff3e37abd59671"} Jun 02 15:33:26.107280 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:26.107001 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:26.136022 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:26.135971 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" podStartSLOduration=2.014722403 podStartE2EDuration="7.135955418s" podCreationTimestamp="2026-06-02 15:33:19 +0000 UTC" firstStartedPulling="2026-06-02 15:33:20.39155525 +0000 UTC m=+585.449725553" lastFinishedPulling="2026-06-02 15:33:25.512788265 +0000 UTC m=+590.570958568" observedRunningTime="2026-06-02 15:33:26.132453512 +0000 UTC m=+591.190623852" watchObservedRunningTime="2026-06-02 15:33:26.135955418 +0000 UTC m=+591.194125744" Jun 02 15:33:37.111951 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:37.111918 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf" Jun 02 15:33:39.797390 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.797333 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9"] Jun 02 15:33:39.805612 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.805590 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.813705 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.813681 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:33:39.813844 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.813682 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 15:33:39.814896 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.814877 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 15:33:39.814962 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.814913 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 15:33:39.814997 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.814975 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 15:33:39.814997 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.814975 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q4xfk\"" Jun 02 15:33:39.833893 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.833865 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9"] Jun 02 15:33:39.888876 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.888843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-metrics-cert\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.889074 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.888899 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-manager-config\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.889074 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.889012 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndtq\" (UniqueName: \"kubernetes.io/projected/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-kube-api-access-wndtq\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.889074 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.889050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-cert\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.989829 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.989786 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-metrics-cert\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.990023 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.989851 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-manager-config\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.990023 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.989895 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wndtq\" (UniqueName: \"kubernetes.io/projected/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-kube-api-access-wndtq\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.990023 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.989924 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-cert\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.990571 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.990547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-manager-config\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.992371 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.992331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-cert\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:39.992467 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:39.992417 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-metrics-cert\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:40.017691 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:40.017656 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndtq\" (UniqueName: \"kubernetes.io/projected/c93128e0-a75a-4c42-a2a2-a470d5b0ee20-kube-api-access-wndtq\") pod \"lws-controller-manager-5546797fcb-bznd9\" (UID: \"c93128e0-a75a-4c42-a2a2-a470d5b0ee20\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:40.114680 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:40.114619 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:40.276672 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:40.276638 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9"] Jun 02 15:33:40.281955 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:33:40.281920 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93128e0_a75a_4c42_a2a2_a470d5b0ee20.slice/crio-d5fd65e649812bdb8ea933ef6cab4c1227e7140026cab87be9937518335032d8 WatchSource:0}: Error finding container d5fd65e649812bdb8ea933ef6cab4c1227e7140026cab87be9937518335032d8: Status 404 returned error can't find the container with id d5fd65e649812bdb8ea933ef6cab4c1227e7140026cab87be9937518335032d8 Jun 02 15:33:41.152292 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:41.152254 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" event={"ID":"c93128e0-a75a-4c42-a2a2-a470d5b0ee20","Type":"ContainerStarted","Data":"d5fd65e649812bdb8ea933ef6cab4c1227e7140026cab87be9937518335032d8"} Jun 02 15:33:43.159133 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:43.159043 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" event={"ID":"c93128e0-a75a-4c42-a2a2-a470d5b0ee20","Type":"ContainerStarted","Data":"72af7b6d37e93105e05db1d1e7a3041f296184e822571849373132e612e8c61b"} Jun 02 15:33:43.159532 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:43.159147 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:33:43.189153 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:43.186463 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" podStartSLOduration=1.611299873 podStartE2EDuration="4.186437407s" podCreationTimestamp="2026-06-02 15:33:39 +0000 UTC" firstStartedPulling="2026-06-02 15:33:40.284058472 +0000 UTC m=+605.342228779" lastFinishedPulling="2026-06-02 15:33:42.859195998 +0000 UTC m=+607.917366313" observedRunningTime="2026-06-02 15:33:43.184399927 +0000 UTC m=+608.242570256" watchObservedRunningTime="2026-06-02 15:33:43.186437407 +0000 UTC m=+608.244607734" Jun 02 15:33:54.164503 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:33:54.164472 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-bznd9" Jun 02 15:34:16.041455 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.041417 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-756bd9f55b-hmktr"] Jun 02 15:34:16.047797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.047777 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.050690 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.050668 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xm97d\"" Jun 02 15:34:16.050690 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.050678 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 15:34:16.054786 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.054763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz5sk\" (UniqueName: \"kubernetes.io/projected/fa10013d-fc2f-4374-ba29-652e451cd1ce-kube-api-access-sz5sk\") pod \"dashboard-redirect-756bd9f55b-hmktr\" (UID: \"fa10013d-fc2f-4374-ba29-652e451cd1ce\") " pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.054897 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.054820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fa10013d-fc2f-4374-ba29-652e451cd1ce-redirect-config\") pod \"dashboard-redirect-756bd9f55b-hmktr\" (UID: \"fa10013d-fc2f-4374-ba29-652e451cd1ce\") " pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.058502 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.058478 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-756bd9f55b-hmktr"] Jun 02 15:34:16.155276 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.155239 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sz5sk\" (UniqueName: \"kubernetes.io/projected/fa10013d-fc2f-4374-ba29-652e451cd1ce-kube-api-access-sz5sk\") pod \"dashboard-redirect-756bd9f55b-hmktr\" (UID: \"fa10013d-fc2f-4374-ba29-652e451cd1ce\") " pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.155462 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.155302 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fa10013d-fc2f-4374-ba29-652e451cd1ce-redirect-config\") pod \"dashboard-redirect-756bd9f55b-hmktr\" (UID: \"fa10013d-fc2f-4374-ba29-652e451cd1ce\") " pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.156040 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.156021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fa10013d-fc2f-4374-ba29-652e451cd1ce-redirect-config\") pod \"dashboard-redirect-756bd9f55b-hmktr\" (UID: \"fa10013d-fc2f-4374-ba29-652e451cd1ce\") " pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.164575 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.164549 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz5sk\" (UniqueName: \"kubernetes.io/projected/fa10013d-fc2f-4374-ba29-652e451cd1ce-kube-api-access-sz5sk\") pod \"dashboard-redirect-756bd9f55b-hmktr\" (UID: \"fa10013d-fc2f-4374-ba29-652e451cd1ce\") " pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.357706 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.357671 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" Jun 02 15:34:16.497744 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:16.497717 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-756bd9f55b-hmktr"] Jun 02 15:34:16.500303 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:34:16.500273 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa10013d_fc2f_4374_ba29_652e451cd1ce.slice/crio-8f1c5a592f07080ca7984b6c0c0c48c72ce634b43fedb67e566580b803ea4e1e WatchSource:0}: Error finding container 8f1c5a592f07080ca7984b6c0c0c48c72ce634b43fedb67e566580b803ea4e1e: Status 404 returned error can't find the container with id 8f1c5a592f07080ca7984b6c0c0c48c72ce634b43fedb67e566580b803ea4e1e Jun 02 15:34:17.249519 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:17.249488 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" event={"ID":"fa10013d-fc2f-4374-ba29-652e451cd1ce","Type":"ContainerStarted","Data":"8f1c5a592f07080ca7984b6c0c0c48c72ce634b43fedb67e566580b803ea4e1e"} Jun 02 15:34:19.258536 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:19.258497 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" event={"ID":"fa10013d-fc2f-4374-ba29-652e451cd1ce","Type":"ContainerStarted","Data":"097e9aebbcfb65bcd1daaf02565c59d93467012d53f43f56a6e60867c05130bc"} Jun 02 15:34:19.293087 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:19.293035 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-756bd9f55b-hmktr" podStartSLOduration=1.182315996 podStartE2EDuration="3.293017816s" podCreationTimestamp="2026-06-02 15:34:16 +0000 UTC" firstStartedPulling="2026-06-02 15:34:16.50159003 +0000 UTC m=+641.559760334" lastFinishedPulling="2026-06-02 15:34:18.612291844 +0000 UTC m=+643.670462154" observedRunningTime="2026-06-02 15:34:19.291246209 +0000 UTC m=+644.349416534" watchObservedRunningTime="2026-06-02 15:34:19.293017816 +0000 UTC m=+644.351188142" Jun 02 15:34:33.291239 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.291203 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh"] Jun 02 15:34:33.294241 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.294214 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.296950 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.296926 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 15:34:33.297072 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.296950 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-59wkt\"" Jun 02 15:34:33.297072 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.297000 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 15:34:33.297245 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.297223 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 15:34:33.308631 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.308608 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh"] Jun 02 15:34:33.366837 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.366794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.366837 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.366841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367059 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.366888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367059 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.366938 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78qxs\" (UniqueName: \"kubernetes.io/projected/11fdeebd-b060-4f4d-b305-ede3025e3d53-kube-api-access-78qxs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367059 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.366960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367059 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.366980 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367059 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.367042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367280 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.367126 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.367280 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.367161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fdeebd-b060-4f4d-b305-ede3025e3d53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468431 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468395 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78qxs\" (UniqueName: \"kubernetes.io/projected/11fdeebd-b060-4f4d-b305-ede3025e3d53-kube-api-access-78qxs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468431 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468433 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468647 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468455 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468647 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468647 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468517 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468647 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468545 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fdeebd-b060-4f4d-b305-ede3025e3d53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468647 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468576 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468647 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468627 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.468925 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468658 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.469020 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.468996 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.469076 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.469027 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.469132 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.469075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.469184 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.469149 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.469265 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.469246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fdeebd-b060-4f4d-b305-ede3025e3d53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.470717 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.470688 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.471155 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.471140 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.478332 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.478307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78qxs\" (UniqueName: \"kubernetes.io/projected/11fdeebd-b060-4f4d-b305-ede3025e3d53-kube-api-access-78qxs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.479106 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.479081 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fdeebd-b060-4f4d-b305-ede3025e3d53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blknrh\" (UID: \"11fdeebd-b060-4f4d-b305-ede3025e3d53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.604701 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.604670 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:33.733539 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:33.733449 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh"] Jun 02 15:34:33.735597 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:34:33.735564 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fdeebd_b060_4f4d_b305_ede3025e3d53.slice/crio-c210b7358e71e31158b8cfe90fb73da13711f1fd3ea81f29a64d30751a7d934b WatchSource:0}: Error finding container c210b7358e71e31158b8cfe90fb73da13711f1fd3ea81f29a64d30751a7d934b: Status 404 returned error can't find the container with id c210b7358e71e31158b8cfe90fb73da13711f1fd3ea81f29a64d30751a7d934b Jun 02 15:34:34.304719 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:34.304683 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" event={"ID":"11fdeebd-b060-4f4d-b305-ede3025e3d53","Type":"ContainerStarted","Data":"c210b7358e71e31158b8cfe90fb73da13711f1fd3ea81f29a64d30751a7d934b"} Jun 02 15:34:36.747989 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:36.747952 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 15:34:36.748380 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:36.748034 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 15:34:36.748380 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:36.748078 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 15:34:37.314425 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:37.314381 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" event={"ID":"11fdeebd-b060-4f4d-b305-ede3025e3d53","Type":"ContainerStarted","Data":"768304a9d154b6eb39f1f26f167c8a53f7f0b3254b254b0c619da9a107af59f7"} Jun 02 15:34:37.337479 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:37.337423 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" podStartSLOduration=1.3271055569999999 podStartE2EDuration="4.337403262s" podCreationTimestamp="2026-06-02 15:34:33 +0000 UTC" firstStartedPulling="2026-06-02 15:34:33.737422697 +0000 UTC m=+658.795593000" lastFinishedPulling="2026-06-02 15:34:36.747720397 +0000 UTC m=+661.805890705" observedRunningTime="2026-06-02 15:34:37.336633533 +0000 UTC m=+662.394803858" watchObservedRunningTime="2026-06-02 15:34:37.337403262 +0000 UTC m=+662.395573592" Jun 02 15:34:37.605821 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:37.605789 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:37.610200 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:37.610175 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:38.316842 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:38.316809 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:38.318132 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:38.318107 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blknrh" Jun 02 15:34:40.891333 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.891299 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ndbc6"] Jun 02 15:34:40.894477 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.894462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:40.897652 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.897632 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 15:34:40.898715 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.898702 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 15:34:40.898800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.898781 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6ndz5\"" Jun 02 15:34:40.902406 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.902386 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ndbc6"] Jun 02 15:34:40.923547 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:40.923514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/d0604f68-a899-44ec-8930-d0133ced6c62-kube-api-access-7cw8m\") pod \"kuadrant-operator-catalog-ndbc6\" (UID: \"d0604f68-a899-44ec-8930-d0133ced6c62\") " pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:41.024455 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.024421 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/d0604f68-a899-44ec-8930-d0133ced6c62-kube-api-access-7cw8m\") pod \"kuadrant-operator-catalog-ndbc6\" (UID: \"d0604f68-a899-44ec-8930-d0133ced6c62\") " pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:41.032585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.032567 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/d0604f68-a899-44ec-8930-d0133ced6c62-kube-api-access-7cw8m\") pod \"kuadrant-operator-catalog-ndbc6\" (UID: \"d0604f68-a899-44ec-8930-d0133ced6c62\") " pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:41.204113 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.204011 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:41.258010 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.257951 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ndbc6"] Jun 02 15:34:41.329806 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.329779 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ndbc6"] Jun 02 15:34:41.332476 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:34:41.332448 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0604f68_a899_44ec_8930_d0133ced6c62.slice/crio-87985a006e13f5370735b8f4d1943f0bb1c7419fbe31a073a70d809fe0bb0db6 WatchSource:0}: Error finding container 87985a006e13f5370735b8f4d1943f0bb1c7419fbe31a073a70d809fe0bb0db6: Status 404 returned error can't find the container with id 87985a006e13f5370735b8f4d1943f0bb1c7419fbe31a073a70d809fe0bb0db6 Jun 02 15:34:41.467689 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.467599 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p6kzt"] Jun 02 15:34:41.471759 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.471744 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:41.482576 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.482550 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p6kzt"] Jun 02 15:34:41.528625 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.528571 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsb6q\" (UniqueName: \"kubernetes.io/projected/03cbc1bb-2225-4f0d-805a-9f7b238a5485-kube-api-access-rsb6q\") pod \"kuadrant-operator-catalog-p6kzt\" (UID: \"03cbc1bb-2225-4f0d-805a-9f7b238a5485\") " pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:41.629492 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.629462 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsb6q\" (UniqueName: \"kubernetes.io/projected/03cbc1bb-2225-4f0d-805a-9f7b238a5485-kube-api-access-rsb6q\") pod \"kuadrant-operator-catalog-p6kzt\" (UID: \"03cbc1bb-2225-4f0d-805a-9f7b238a5485\") " pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:41.639018 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.638987 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsb6q\" (UniqueName: \"kubernetes.io/projected/03cbc1bb-2225-4f0d-805a-9f7b238a5485-kube-api-access-rsb6q\") pod \"kuadrant-operator-catalog-p6kzt\" (UID: \"03cbc1bb-2225-4f0d-805a-9f7b238a5485\") " pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:41.780969 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.780887 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:41.915192 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:41.915163 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p6kzt"] Jun 02 15:34:42.328281 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:42.328245 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" event={"ID":"d0604f68-a899-44ec-8930-d0133ced6c62","Type":"ContainerStarted","Data":"87985a006e13f5370735b8f4d1943f0bb1c7419fbe31a073a70d809fe0bb0db6"} Jun 02 15:34:42.329237 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:42.329212 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" event={"ID":"03cbc1bb-2225-4f0d-805a-9f7b238a5485","Type":"ContainerStarted","Data":"231c22e56df8be6b1437afb9208bfd34e44845fce22bf695de773c33916ed867"} Jun 02 15:34:44.336750 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.336710 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" event={"ID":"d0604f68-a899-44ec-8930-d0133ced6c62","Type":"ContainerStarted","Data":"8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c"} Jun 02 15:34:44.337290 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.336804 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" podUID="d0604f68-a899-44ec-8930-d0133ced6c62" containerName="registry-server" containerID="cri-o://8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c" gracePeriod=2 Jun 02 15:34:44.338137 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.338096 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" event={"ID":"03cbc1bb-2225-4f0d-805a-9f7b238a5485","Type":"ContainerStarted","Data":"a940b218716708c9fb0cf4888a8e51db2ff546ff1d44ae301cd994dfdbc73651"} Jun 02 15:34:44.354242 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.354194 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" podStartSLOduration=2.172254875 podStartE2EDuration="4.3541781s" podCreationTimestamp="2026-06-02 15:34:40 +0000 UTC" firstStartedPulling="2026-06-02 15:34:41.333863848 +0000 UTC m=+666.392034152" lastFinishedPulling="2026-06-02 15:34:43.515787073 +0000 UTC m=+668.573957377" observedRunningTime="2026-06-02 15:34:44.353027104 +0000 UTC m=+669.411197459" watchObservedRunningTime="2026-06-02 15:34:44.3541781 +0000 UTC m=+669.412348428" Jun 02 15:34:44.369080 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.369040 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" podStartSLOduration=1.803351849 podStartE2EDuration="3.369024344s" podCreationTimestamp="2026-06-02 15:34:41 +0000 UTC" firstStartedPulling="2026-06-02 15:34:41.952668656 +0000 UTC m=+667.010838962" lastFinishedPulling="2026-06-02 15:34:43.51834115 +0000 UTC m=+668.576511457" observedRunningTime="2026-06-02 15:34:44.368339721 +0000 UTC m=+669.426510051" watchObservedRunningTime="2026-06-02 15:34:44.369024344 +0000 UTC m=+669.427194670" Jun 02 15:34:44.575369 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.575328 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:44.656330 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.656252 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/d0604f68-a899-44ec-8930-d0133ced6c62-kube-api-access-7cw8m\") pod \"d0604f68-a899-44ec-8930-d0133ced6c62\" (UID: \"d0604f68-a899-44ec-8930-d0133ced6c62\") " Jun 02 15:34:44.658398 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.658369 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0604f68-a899-44ec-8930-d0133ced6c62-kube-api-access-7cw8m" (OuterVolumeSpecName: "kube-api-access-7cw8m") pod "d0604f68-a899-44ec-8930-d0133ced6c62" (UID: "d0604f68-a899-44ec-8930-d0133ced6c62"). InnerVolumeSpecName "kube-api-access-7cw8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:34:44.756991 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:44.756955 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/d0604f68-a899-44ec-8930-d0133ced6c62-kube-api-access-7cw8m\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:34:45.342229 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.342193 2555 generic.go:358] "Generic (PLEG): container finished" podID="d0604f68-a899-44ec-8930-d0133ced6c62" containerID="8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c" exitCode=0 Jun 02 15:34:45.342658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.342247 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" Jun 02 15:34:45.342658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.342281 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" event={"ID":"d0604f68-a899-44ec-8930-d0133ced6c62","Type":"ContainerDied","Data":"8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c"} Jun 02 15:34:45.342658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.342316 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ndbc6" event={"ID":"d0604f68-a899-44ec-8930-d0133ced6c62","Type":"ContainerDied","Data":"87985a006e13f5370735b8f4d1943f0bb1c7419fbe31a073a70d809fe0bb0db6"} Jun 02 15:34:45.342658 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.342331 2555 scope.go:117] "RemoveContainer" containerID="8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c" Jun 02 15:34:45.350766 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.350749 2555 scope.go:117] "RemoveContainer" containerID="8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c" Jun 02 15:34:45.351005 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:34:45.350986 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c\": container with ID starting with 8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c not found: ID does not exist" containerID="8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c" Jun 02 15:34:45.351050 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.351012 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c"} err="failed to get container status \"8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c\": rpc error: code = NotFound desc = could not find container \"8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c\": container with ID starting with 8e4ed2593e59227ddd13f1b1aeca1ffec04a4272d0292715d51610dd58ddfc3c not found: ID does not exist" Jun 02 15:34:45.363005 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.362981 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ndbc6"] Jun 02 15:34:45.367371 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.367319 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ndbc6"] Jun 02 15:34:45.489798 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:45.489766 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0604f68-a899-44ec-8930-d0133ced6c62" path="/var/lib/kubelet/pods/d0604f68-a899-44ec-8930-d0133ced6c62/volumes" Jun 02 15:34:51.781255 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:51.781220 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:51.781722 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:51.781394 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:51.802719 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:51.802690 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:34:52.384644 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:34:52.384619 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-p6kzt" Jun 02 15:35:19.835752 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.835715 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p"] Jun 02 15:35:19.836191 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.835993 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0604f68-a899-44ec-8930-d0133ced6c62" containerName="registry-server" Jun 02 15:35:19.836191 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.836003 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0604f68-a899-44ec-8930-d0133ced6c62" containerName="registry-server" Jun 02 15:35:19.836191 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.836059 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0604f68-a899-44ec-8930-d0133ced6c62" containerName="registry-server" Jun 02 15:35:19.845687 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.845662 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:19.849397 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.849373 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h62zn\"" Jun 02 15:35:19.854926 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.854901 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p"] Jun 02 15:35:19.931731 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.931694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47598f7-b942-468b-bf4f-1818607bd1c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:19.931909 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:19.931746 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjffk\" (UniqueName: \"kubernetes.io/projected/b47598f7-b942-468b-bf4f-1818607bd1c0-kube-api-access-gjffk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:20.033023 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.032987 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47598f7-b942-468b-bf4f-1818607bd1c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:20.033219 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.033039 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjffk\" (UniqueName: \"kubernetes.io/projected/b47598f7-b942-468b-bf4f-1818607bd1c0-kube-api-access-gjffk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:20.033438 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.033414 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47598f7-b942-468b-bf4f-1818607bd1c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:20.045761 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.045727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjffk\" (UniqueName: \"kubernetes.io/projected/b47598f7-b942-468b-bf4f-1818607bd1c0-kube-api-access-gjffk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:20.156719 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.156628 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:20.284788 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.284757 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p"] Jun 02 15:35:20.287979 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:35:20.287953 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47598f7_b942_468b_bf4f_1818607bd1c0.slice/crio-dd6d1d7a521c7b25ce9feae8d812d1c4db15b7eab45b0293d5373d007f321fbd WatchSource:0}: Error finding container dd6d1d7a521c7b25ce9feae8d812d1c4db15b7eab45b0293d5373d007f321fbd: Status 404 returned error can't find the container with id dd6d1d7a521c7b25ce9feae8d812d1c4db15b7eab45b0293d5373d007f321fbd Jun 02 15:35:20.452223 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:20.452131 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" event={"ID":"b47598f7-b942-468b-bf4f-1818607bd1c0","Type":"ContainerStarted","Data":"dd6d1d7a521c7b25ce9feae8d812d1c4db15b7eab45b0293d5373d007f321fbd"} Jun 02 15:35:26.471640 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:26.471604 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" event={"ID":"b47598f7-b942-468b-bf4f-1818607bd1c0","Type":"ContainerStarted","Data":"859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb"} Jun 02 15:35:26.472021 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:26.471725 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:26.504069 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:26.504025 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" podStartSLOduration=1.89110607 podStartE2EDuration="7.504011298s" podCreationTimestamp="2026-06-02 15:35:19 +0000 UTC" firstStartedPulling="2026-06-02 15:35:20.290315661 +0000 UTC m=+705.348485965" lastFinishedPulling="2026-06-02 15:35:25.903220884 +0000 UTC m=+710.961391193" observedRunningTime="2026-06-02 15:35:26.503238104 +0000 UTC m=+711.561408442" watchObservedRunningTime="2026-06-02 15:35:26.504011298 +0000 UTC m=+711.562181624" Jun 02 15:35:28.409411 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.409371 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z754r"] Jun 02 15:35:28.412509 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.412491 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:28.415417 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.415394 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jz5zb\"" Jun 02 15:35:28.425713 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.425688 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z754r"] Jun 02 15:35:28.503880 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.503851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrz7\" (UniqueName: \"kubernetes.io/projected/a14488a3-706a-47bd-9c20-4bc1c6b8f133-kube-api-access-cxrz7\") pod \"authorino-operator-657f44b778-z754r\" (UID: \"a14488a3-706a-47bd-9c20-4bc1c6b8f133\") " pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:28.604272 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.604234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrz7\" (UniqueName: \"kubernetes.io/projected/a14488a3-706a-47bd-9c20-4bc1c6b8f133-kube-api-access-cxrz7\") pod \"authorino-operator-657f44b778-z754r\" (UID: \"a14488a3-706a-47bd-9c20-4bc1c6b8f133\") " pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:28.617911 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.617875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrz7\" (UniqueName: \"kubernetes.io/projected/a14488a3-706a-47bd-9c20-4bc1c6b8f133-kube-api-access-cxrz7\") pod \"authorino-operator-657f44b778-z754r\" (UID: \"a14488a3-706a-47bd-9c20-4bc1c6b8f133\") " pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:28.722186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.722094 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:28.858177 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:28.858148 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z754r"] Jun 02 15:35:28.859644 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:35:28.859616 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14488a3_706a_47bd_9c20_4bc1c6b8f133.slice/crio-1aeee7a517eabab6728b5685dcfa5e92c3d1e2e35763171ba3303d96e1c63de5 WatchSource:0}: Error finding container 1aeee7a517eabab6728b5685dcfa5e92c3d1e2e35763171ba3303d96e1c63de5: Status 404 returned error can't find the container with id 1aeee7a517eabab6728b5685dcfa5e92c3d1e2e35763171ba3303d96e1c63de5 Jun 02 15:35:29.487920 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:29.487886 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-z754r" event={"ID":"a14488a3-706a-47bd-9c20-4bc1c6b8f133","Type":"ContainerStarted","Data":"1aeee7a517eabab6728b5685dcfa5e92c3d1e2e35763171ba3303d96e1c63de5"} Jun 02 15:35:32.498538 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:32.498495 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-z754r" event={"ID":"a14488a3-706a-47bd-9c20-4bc1c6b8f133","Type":"ContainerStarted","Data":"1460c538a47e97cf5492ab0499fd239f119a2a22022d1fca4aed9e655ec31448"} Jun 02 15:35:32.498974 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:32.498637 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:32.519502 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:32.519442 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-z754r" podStartSLOduration=1.75792306 podStartE2EDuration="4.519426956s" podCreationTimestamp="2026-06-02 15:35:28 +0000 UTC" firstStartedPulling="2026-06-02 15:35:28.862063551 +0000 UTC m=+713.920233858" lastFinishedPulling="2026-06-02 15:35:31.623567448 +0000 UTC m=+716.681737754" observedRunningTime="2026-06-02 15:35:32.518901946 +0000 UTC m=+717.577072272" watchObservedRunningTime="2026-06-02 15:35:32.519426956 +0000 UTC m=+717.577597283" Jun 02 15:35:37.477761 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:37.477732 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:39.518702 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.518664 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p"] Jun 02 15:35:39.519161 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.518953 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" containerName="manager" containerID="cri-o://859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb" gracePeriod=2 Jun 02 15:35:39.527871 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.527836 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p"] Jun 02 15:35:39.547533 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.547491 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r"] Jun 02 15:35:39.547927 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.547905 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" containerName="manager" Jun 02 15:35:39.547989 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.547928 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" containerName="manager" Jun 02 15:35:39.548028 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.547996 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" containerName="manager" Jun 02 15:35:39.551065 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.551044 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.590125 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.590099 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xpn6r\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.590238 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.590151 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pthmn\" (UniqueName: \"kubernetes.io/projected/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-kube-api-access-pthmn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xpn6r\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.602143 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.602115 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r"] Jun 02 15:35:39.688044 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.687723 2555 status_manager.go:895] "Failed to get status for pod" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" is forbidden: User \"system:node:ip-10-0-140-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-163.ec2.internal' and this object" Jun 02 15:35:39.693697 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.692934 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xpn6r\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.693697 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.692980 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pthmn\" (UniqueName: \"kubernetes.io/projected/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-kube-api-access-pthmn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xpn6r\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.693697 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.693635 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xpn6r\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.716400 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.716176 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pthmn\" (UniqueName: \"kubernetes.io/projected/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-kube-api-access-pthmn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xpn6r\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.780150 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.780128 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:39.783114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.783079 2555 status_manager.go:895] "Failed to get status for pod" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" is forbidden: User \"system:node:ip-10-0-140-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-163.ec2.internal' and this object" Jun 02 15:35:39.793581 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.793538 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47598f7-b942-468b-bf4f-1818607bd1c0-extensions-socket-volume\") pod \"b47598f7-b942-468b-bf4f-1818607bd1c0\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " Jun 02 15:35:39.793665 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.793589 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjffk\" (UniqueName: \"kubernetes.io/projected/b47598f7-b942-468b-bf4f-1818607bd1c0-kube-api-access-gjffk\") pod \"b47598f7-b942-468b-bf4f-1818607bd1c0\" (UID: \"b47598f7-b942-468b-bf4f-1818607bd1c0\") " Jun 02 15:35:39.793918 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.793897 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47598f7-b942-468b-bf4f-1818607bd1c0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b47598f7-b942-468b-bf4f-1818607bd1c0" (UID: "b47598f7-b942-468b-bf4f-1818607bd1c0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:39.795574 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.795542 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47598f7-b942-468b-bf4f-1818607bd1c0-kube-api-access-gjffk" (OuterVolumeSpecName: "kube-api-access-gjffk") pod "b47598f7-b942-468b-bf4f-1818607bd1c0" (UID: "b47598f7-b942-468b-bf4f-1818607bd1c0"). InnerVolumeSpecName "kube-api-access-gjffk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:35:39.891195 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.891156 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:39.894114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.894094 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47598f7-b942-468b-bf4f-1818607bd1c0-extensions-socket-volume\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:35:39.894180 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:39.894116 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjffk\" (UniqueName: \"kubernetes.io/projected/b47598f7-b942-468b-bf4f-1818607bd1c0-kube-api-access-gjffk\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:35:40.016790 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.016767 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r"] Jun 02 15:35:40.019093 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:35:40.019059 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1a1623_bf46_46a5_a3f8_09d67cd1dbaa.slice/crio-1086b6fd634462565a50f7d20dcedeced8bde7070f3873f875b1d6c686d807d1 WatchSource:0}: Error finding container 1086b6fd634462565a50f7d20dcedeced8bde7070f3873f875b1d6c686d807d1: Status 404 returned error can't find the container with id 1086b6fd634462565a50f7d20dcedeced8bde7070f3873f875b1d6c686d807d1 Jun 02 15:35:40.523751 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.523715 2555 generic.go:358] "Generic (PLEG): container finished" podID="b47598f7-b942-468b-bf4f-1818607bd1c0" containerID="859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb" exitCode=0 Jun 02 15:35:40.524153 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.523756 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" Jun 02 15:35:40.524153 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.523810 2555 scope.go:117] "RemoveContainer" containerID="859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb" Jun 02 15:35:40.525288 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.525262 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" event={"ID":"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa","Type":"ContainerStarted","Data":"1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9"} Jun 02 15:35:40.525428 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.525298 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" event={"ID":"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa","Type":"ContainerStarted","Data":"1086b6fd634462565a50f7d20dcedeced8bde7070f3873f875b1d6c686d807d1"} Jun 02 15:35:40.525428 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.525394 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:35:40.527465 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.527435 2555 status_manager.go:895] "Failed to get status for pod" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" is forbidden: User \"system:node:ip-10-0-140-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-163.ec2.internal' and this object" Jun 02 15:35:40.531921 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.531903 2555 scope.go:117] "RemoveContainer" containerID="859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb" Jun 02 15:35:40.532167 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:35:40.532147 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb\": container with ID starting with 859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb not found: ID does not exist" containerID="859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb" Jun 02 15:35:40.532211 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.532174 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb"} err="failed to get container status \"859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb\": rpc error: code = NotFound desc = could not find container \"859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb\": container with ID starting with 859a62466eaa54b2e857759fc19b68053270dc379c23e8a3811302cd0c4394bb not found: ID does not exist" Jun 02 15:35:40.564160 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.564115 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" podStartSLOduration=1.564101913 podStartE2EDuration="1.564101913s" podCreationTimestamp="2026-06-02 15:35:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:35:40.56254863 +0000 UTC m=+725.620718956" watchObservedRunningTime="2026-06-02 15:35:40.564101913 +0000 UTC m=+725.622272236" Jun 02 15:35:40.565156 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.565128 2555 status_manager.go:895] "Failed to get status for pod" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" is forbidden: User \"system:node:ip-10-0-140-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-163.ec2.internal' and this object" Jun 02 15:35:40.567403 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:40.567368 2555 status_manager.go:895] "Failed to get status for pod" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9cx8p" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9cx8p\" is forbidden: User \"system:node:ip-10-0-140-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-163.ec2.internal' and this object" Jun 02 15:35:41.488078 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:41.488047 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b47598f7-b942-468b-bf4f-1818607bd1c0" path="/var/lib/kubelet/pods/b47598f7-b942-468b-bf4f-1818607bd1c0/volumes" Jun 02 15:35:43.503229 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:43.503198 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-z754r" Jun 02 15:35:51.531809 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:35:51.531778 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:36:11.572353 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.572321 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r"] Jun 02 15:36:11.572788 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.572575 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" podUID="ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" containerName="manager" containerID="cri-o://1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9" gracePeriod=10 Jun 02 15:36:11.809664 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.809639 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:36:11.921228 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.921193 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-extensions-socket-volume\") pod \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " Jun 02 15:36:11.921437 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.921248 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pthmn\" (UniqueName: \"kubernetes.io/projected/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-kube-api-access-pthmn\") pod \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\" (UID: \"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa\") " Jun 02 15:36:11.921727 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.921700 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" (UID: "ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:36:11.923364 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:11.923324 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-kube-api-access-pthmn" (OuterVolumeSpecName: "kube-api-access-pthmn") pod "ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" (UID: "ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa"). InnerVolumeSpecName "kube-api-access-pthmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:36:12.021895 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.021860 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pthmn\" (UniqueName: \"kubernetes.io/projected/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-kube-api-access-pthmn\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:36:12.021895 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.021887 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa-extensions-socket-volume\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:36:12.623536 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.623498 2555 generic.go:358] "Generic (PLEG): container finished" podID="ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" containerID="1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9" exitCode=0 Jun 02 15:36:12.624006 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.623541 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" event={"ID":"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa","Type":"ContainerDied","Data":"1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9"} Jun 02 15:36:12.624006 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.623560 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" Jun 02 15:36:12.624006 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.623574 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r" event={"ID":"ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa","Type":"ContainerDied","Data":"1086b6fd634462565a50f7d20dcedeced8bde7070f3873f875b1d6c686d807d1"} Jun 02 15:36:12.624006 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.623605 2555 scope.go:117] "RemoveContainer" containerID="1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9" Jun 02 15:36:12.632227 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.632210 2555 scope.go:117] "RemoveContainer" containerID="1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9" Jun 02 15:36:12.632518 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:36:12.632499 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9\": container with ID starting with 1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9 not found: ID does not exist" containerID="1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9" Jun 02 15:36:12.632590 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.632526 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9"} err="failed to get container status \"1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9\": rpc error: code = NotFound desc = could not find container \"1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9\": container with ID starting with 1d18a84eccaeb485496bc96370b22bc4aab5ab5d7e229c5499acc167db08b5c9 not found: ID does not exist" Jun 02 15:36:12.647429 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.647401 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r"] Jun 02 15:36:12.666025 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:12.665998 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xpn6r"] Jun 02 15:36:13.488118 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:13.488087 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" path="/var/lib/kubelet/pods/ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa/volumes" Jun 02 15:36:28.107992 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.107952 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm"] Jun 02 15:36:28.108452 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.108239 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" containerName="manager" Jun 02 15:36:28.108452 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.108250 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" containerName="manager" Jun 02 15:36:28.108452 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.108309 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef1a1623-bf46-46a5-a3f8-09d67cd1dbaa" containerName="manager" Jun 02 15:36:28.111094 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.111077 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.117212 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.116974 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-whgqf\"" Jun 02 15:36:28.128797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.128776 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm"] Jun 02 15:36:28.143450 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6492fa59-e648-44a8-8666-53bd64d3e894-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6492fa59-e648-44a8-8666-53bd64d3e894-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143581 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143689 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qxbq\" (UniqueName: \"kubernetes.io/projected/6492fa59-e648-44a8-8666-53bd64d3e894-kube-api-access-9qxbq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.143747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.143724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6492fa59-e648-44a8-8666-53bd64d3e894-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244547 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244504 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244547 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244552 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6492fa59-e648-44a8-8666-53bd64d3e894-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244590 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6492fa59-e648-44a8-8666-53bd64d3e894-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244622 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244651 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244676 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244701 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244726 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qxbq\" (UniqueName: \"kubernetes.io/projected/6492fa59-e648-44a8-8666-53bd64d3e894-kube-api-access-9qxbq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.244797 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244768 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6492fa59-e648-44a8-8666-53bd64d3e894-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.245137 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.244951 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.245137 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.245061 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.245232 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.245188 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.245302 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.245277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.245435 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.245415 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6492fa59-e648-44a8-8666-53bd64d3e894-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.246860 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.246833 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6492fa59-e648-44a8-8666-53bd64d3e894-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.247334 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.247319 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6492fa59-e648-44a8-8666-53bd64d3e894-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.259910 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.259882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6492fa59-e648-44a8-8666-53bd64d3e894-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.260007 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.259986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qxbq\" (UniqueName: \"kubernetes.io/projected/6492fa59-e648-44a8-8666-53bd64d3e894-kube-api-access-9qxbq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4zrkm\" (UID: \"6492fa59-e648-44a8-8666-53bd64d3e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.420769 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.420673 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:28.564469 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.564442 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm"] Jun 02 15:36:28.565385 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:36:28.565362 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6492fa59_e648_44a8_8666_53bd64d3e894.slice/crio-2e6e1c5d59a39e3f9328eb1dc0f70d3e228b3957d969cedb1385d2c5783b076c WatchSource:0}: Error finding container 2e6e1c5d59a39e3f9328eb1dc0f70d3e228b3957d969cedb1385d2c5783b076c: Status 404 returned error can't find the container with id 2e6e1c5d59a39e3f9328eb1dc0f70d3e228b3957d969cedb1385d2c5783b076c Jun 02 15:36:28.567319 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.567292 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 15:36:28.567412 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.567368 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 15:36:28.567412 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.567399 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 15:36:28.675483 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.675401 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" event={"ID":"6492fa59-e648-44a8-8666-53bd64d3e894","Type":"ContainerStarted","Data":"afdfa41b882255432e73cb366d0af06d6d957c4cd1ae20b39df8d800ea8e982b"} Jun 02 15:36:28.675483 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.675444 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" event={"ID":"6492fa59-e648-44a8-8666-53bd64d3e894","Type":"ContainerStarted","Data":"2e6e1c5d59a39e3f9328eb1dc0f70d3e228b3957d969cedb1385d2c5783b076c"} Jun 02 15:36:28.726898 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:28.726843 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" podStartSLOduration=0.726825021 podStartE2EDuration="726.825021ms" podCreationTimestamp="2026-06-02 15:36:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:36:28.725118554 +0000 UTC m=+773.783288881" watchObservedRunningTime="2026-06-02 15:36:28.726825021 +0000 UTC m=+773.784995348" Jun 02 15:36:29.421190 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:29.421158 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:29.425784 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:29.425760 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:29.679286 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:29.679206 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:29.680262 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:29.680242 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4zrkm" Jun 02 15:36:31.497438 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.497409 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:36:31.500577 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.500556 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.503601 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.503578 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhqjm\"" Jun 02 15:36:31.503792 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.503780 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 15:36:31.515052 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.515022 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:36:31.537186 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.537157 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:36:31.575504 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.575472 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34e2fe50-7eb1-49a3-8b12-924d561ed42d-config-file\") pod \"limitador-limitador-78c99df468-drzmd\" (UID: \"34e2fe50-7eb1-49a3-8b12-924d561ed42d\") " pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.575667 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.575508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9xxw\" (UniqueName: \"kubernetes.io/projected/34e2fe50-7eb1-49a3-8b12-924d561ed42d-kube-api-access-x9xxw\") pod \"limitador-limitador-78c99df468-drzmd\" (UID: \"34e2fe50-7eb1-49a3-8b12-924d561ed42d\") " pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.676278 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.676241 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34e2fe50-7eb1-49a3-8b12-924d561ed42d-config-file\") pod \"limitador-limitador-78c99df468-drzmd\" (UID: \"34e2fe50-7eb1-49a3-8b12-924d561ed42d\") " pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.676462 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.676287 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xxw\" (UniqueName: \"kubernetes.io/projected/34e2fe50-7eb1-49a3-8b12-924d561ed42d-kube-api-access-x9xxw\") pod \"limitador-limitador-78c99df468-drzmd\" (UID: \"34e2fe50-7eb1-49a3-8b12-924d561ed42d\") " pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.676893 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.676875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34e2fe50-7eb1-49a3-8b12-924d561ed42d-config-file\") pod \"limitador-limitador-78c99df468-drzmd\" (UID: \"34e2fe50-7eb1-49a3-8b12-924d561ed42d\") " pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.691585 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.691562 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9xxw\" (UniqueName: \"kubernetes.io/projected/34e2fe50-7eb1-49a3-8b12-924d561ed42d-kube-api-access-x9xxw\") pod \"limitador-limitador-78c99df468-drzmd\" (UID: \"34e2fe50-7eb1-49a3-8b12-924d561ed42d\") " pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.810084 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.810012 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:31.939697 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.939675 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:36:31.942565 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:36:31.942527 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e2fe50_7eb1_49a3_8b12_924d561ed42d.slice/crio-58ce442e2df565b1b1930a17a7a841541aceaa197b57841b85f3025ce961c9eb WatchSource:0}: Error finding container 58ce442e2df565b1b1930a17a7a841541aceaa197b57841b85f3025ce961c9eb: Status 404 returned error can't find the container with id 58ce442e2df565b1b1930a17a7a841541aceaa197b57841b85f3025ce961c9eb Jun 02 15:36:31.943249 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.943227 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c7jq8"] Jun 02 15:36:31.947879 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.947856 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:31.951120 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.951100 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mhwwk\"" Jun 02 15:36:31.954063 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:31.954041 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c7jq8"] Jun 02 15:36:32.080501 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.080476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmk4\" (UniqueName: \"kubernetes.io/projected/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed-kube-api-access-ksmk4\") pod \"authorino-f99f4b5cd-c7jq8\" (UID: \"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed\") " pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:32.126018 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.125984 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-p46pn"] Jun 02 15:36:32.129117 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.129097 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:36:32.150511 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.150481 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-p46pn"] Jun 02 15:36:32.181878 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.181845 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvzjr\" (UniqueName: \"kubernetes.io/projected/2e8e5c22-190d-44bb-b906-42dc3ed46e46-kube-api-access-jvzjr\") pod \"authorino-7498df8756-p46pn\" (UID: \"2e8e5c22-190d-44bb-b906-42dc3ed46e46\") " pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:36:32.182063 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.181908 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmk4\" (UniqueName: \"kubernetes.io/projected/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed-kube-api-access-ksmk4\") pod \"authorino-f99f4b5cd-c7jq8\" (UID: \"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed\") " pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:32.199802 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.199761 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmk4\" (UniqueName: \"kubernetes.io/projected/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed-kube-api-access-ksmk4\") pod \"authorino-f99f4b5cd-c7jq8\" (UID: \"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed\") " pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:32.258637 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.258600 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:32.283042 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.282661 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvzjr\" (UniqueName: \"kubernetes.io/projected/2e8e5c22-190d-44bb-b906-42dc3ed46e46-kube-api-access-jvzjr\") pod \"authorino-7498df8756-p46pn\" (UID: \"2e8e5c22-190d-44bb-b906-42dc3ed46e46\") " pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:36:32.294011 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.293958 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvzjr\" (UniqueName: \"kubernetes.io/projected/2e8e5c22-190d-44bb-b906-42dc3ed46e46-kube-api-access-jvzjr\") pod \"authorino-7498df8756-p46pn\" (UID: \"2e8e5c22-190d-44bb-b906-42dc3ed46e46\") " pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:36:32.434180 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.434146 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c7jq8"] Jun 02 15:36:32.438139 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.438113 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:36:32.618452 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.618425 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-p46pn"] Jun 02 15:36:32.620207 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:36:32.620174 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e8e5c22_190d_44bb_b906_42dc3ed46e46.slice/crio-beef758719b7da93e5db540b41be3929a242464981fff146130afa51f90d734a WatchSource:0}: Error finding container beef758719b7da93e5db540b41be3929a242464981fff146130afa51f90d734a: Status 404 returned error can't find the container with id beef758719b7da93e5db540b41be3929a242464981fff146130afa51f90d734a Jun 02 15:36:32.689935 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.689900 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" event={"ID":"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed","Type":"ContainerStarted","Data":"202512632d320d5a091deacea853acede6630226c953a88b1b0138838a963291"} Jun 02 15:36:32.690976 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.690948 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p46pn" event={"ID":"2e8e5c22-190d-44bb-b906-42dc3ed46e46","Type":"ContainerStarted","Data":"beef758719b7da93e5db540b41be3929a242464981fff146130afa51f90d734a"} Jun 02 15:36:32.692136 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:32.692103 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" event={"ID":"34e2fe50-7eb1-49a3-8b12-924d561ed42d","Type":"ContainerStarted","Data":"58ce442e2df565b1b1930a17a7a841541aceaa197b57841b85f3025ce961c9eb"} Jun 02 15:36:37.711485 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.711438 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" event={"ID":"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed","Type":"ContainerStarted","Data":"cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66"} Jun 02 15:36:37.712754 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.712731 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p46pn" event={"ID":"2e8e5c22-190d-44bb-b906-42dc3ed46e46","Type":"ContainerStarted","Data":"bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686"} Jun 02 15:36:37.714077 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.714052 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" event={"ID":"34e2fe50-7eb1-49a3-8b12-924d561ed42d","Type":"ContainerStarted","Data":"64a8b03a81f1ff66b10abc79f5ba5ad8907c2ac7736c6f95479f4fc7ad65f8c7"} Jun 02 15:36:37.714193 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.714157 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:36:37.740438 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.740391 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" podStartSLOduration=2.400539792 podStartE2EDuration="6.740376536s" podCreationTimestamp="2026-06-02 15:36:31 +0000 UTC" firstStartedPulling="2026-06-02 15:36:32.440279983 +0000 UTC m=+777.498450287" lastFinishedPulling="2026-06-02 15:36:36.780116718 +0000 UTC m=+781.838287031" observedRunningTime="2026-06-02 15:36:37.736953037 +0000 UTC m=+782.795123363" watchObservedRunningTime="2026-06-02 15:36:37.740376536 +0000 UTC m=+782.798546863" Jun 02 15:36:37.794513 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.794455 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-p46pn" podStartSLOduration=1.63514479 podStartE2EDuration="5.794439022s" podCreationTimestamp="2026-06-02 15:36:32 +0000 UTC" firstStartedPulling="2026-06-02 15:36:32.621602971 +0000 UTC m=+777.679773276" lastFinishedPulling="2026-06-02 15:36:36.780897197 +0000 UTC m=+781.839067508" observedRunningTime="2026-06-02 15:36:37.792850494 +0000 UTC m=+782.851020820" watchObservedRunningTime="2026-06-02 15:36:37.794439022 +0000 UTC m=+782.852609347" Jun 02 15:36:37.840644 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.840608 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c7jq8"] Jun 02 15:36:37.848367 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:37.848307 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" podStartSLOduration=2.002789513 podStartE2EDuration="6.848293085s" podCreationTimestamp="2026-06-02 15:36:31 +0000 UTC" firstStartedPulling="2026-06-02 15:36:31.944791007 +0000 UTC m=+777.002961311" lastFinishedPulling="2026-06-02 15:36:36.790294579 +0000 UTC m=+781.848464883" observedRunningTime="2026-06-02 15:36:37.848178867 +0000 UTC m=+782.906349192" watchObservedRunningTime="2026-06-02 15:36:37.848293085 +0000 UTC m=+782.906463421" Jun 02 15:36:39.719704 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:39.719660 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" podUID="96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" containerName="authorino" containerID="cri-o://cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66" gracePeriod=30 Jun 02 15:36:39.960756 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:39.960732 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:40.048648 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.048568 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksmk4\" (UniqueName: \"kubernetes.io/projected/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed-kube-api-access-ksmk4\") pod \"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed\" (UID: \"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed\") " Jun 02 15:36:40.050724 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.050699 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed-kube-api-access-ksmk4" (OuterVolumeSpecName: "kube-api-access-ksmk4") pod "96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" (UID: "96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed"). InnerVolumeSpecName "kube-api-access-ksmk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:36:40.149243 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.149209 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksmk4\" (UniqueName: \"kubernetes.io/projected/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed-kube-api-access-ksmk4\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:36:40.723440 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.723400 2555 generic.go:358] "Generic (PLEG): container finished" podID="96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" containerID="cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66" exitCode=0 Jun 02 15:36:40.723839 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.723443 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" event={"ID":"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed","Type":"ContainerDied","Data":"cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66"} Jun 02 15:36:40.723839 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.723453 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" Jun 02 15:36:40.723839 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.723488 2555 scope.go:117] "RemoveContainer" containerID="cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66" Jun 02 15:36:40.723839 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.723479 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c7jq8" event={"ID":"96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed","Type":"ContainerDied","Data":"202512632d320d5a091deacea853acede6630226c953a88b1b0138838a963291"} Jun 02 15:36:40.731630 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.731563 2555 scope.go:117] "RemoveContainer" containerID="cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66" Jun 02 15:36:40.731862 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:36:40.731844 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66\": container with ID starting with cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66 not found: ID does not exist" containerID="cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66" Jun 02 15:36:40.731924 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.731873 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66"} err="failed to get container status \"cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66\": rpc error: code = NotFound desc = could not find container \"cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66\": container with ID starting with cbc0cc0babd61c9727e62529fac54ffa2f8d6200ae095c46abd3a289386caa66 not found: ID does not exist" Jun 02 15:36:40.750733 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.750683 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c7jq8"] Jun 02 15:36:40.752548 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:40.752526 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c7jq8"] Jun 02 15:36:41.488341 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:41.488308 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" path="/var/lib/kubelet/pods/96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed/volumes" Jun 02 15:36:48.718580 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:36:48.718546 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-drzmd" Jun 02 15:37:59.900067 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.900030 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bpvc5"] Jun 02 15:37:59.900516 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.900313 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" containerName="authorino" Jun 02 15:37:59.900516 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.900325 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" containerName="authorino" Jun 02 15:37:59.900516 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.900405 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="96261fa7-d8e1-4fe0-8c0f-f7bb0aeacfed" containerName="authorino" Jun 02 15:37:59.903013 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.902997 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:37:59.910897 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.910875 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bpvc5"] Jun 02 15:37:59.975400 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:37:59.975341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvq82\" (UniqueName: \"kubernetes.io/projected/8878eee5-4bcd-4370-9633-838b0333866c-kube-api-access-wvq82\") pod \"authorino-8b475cf9f-bpvc5\" (UID: \"8878eee5-4bcd-4370-9633-838b0333866c\") " pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:38:00.076183 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.076148 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvq82\" (UniqueName: \"kubernetes.io/projected/8878eee5-4bcd-4370-9633-838b0333866c-kube-api-access-wvq82\") pod \"authorino-8b475cf9f-bpvc5\" (UID: \"8878eee5-4bcd-4370-9633-838b0333866c\") " pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:38:00.091952 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.091920 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvq82\" (UniqueName: \"kubernetes.io/projected/8878eee5-4bcd-4370-9633-838b0333866c-kube-api-access-wvq82\") pod \"authorino-8b475cf9f-bpvc5\" (UID: \"8878eee5-4bcd-4370-9633-838b0333866c\") " pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:38:00.212432 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.212326 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:38:00.242741 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.242711 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bpvc5"] Jun 02 15:38:00.291242 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.291164 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4cc769c5-888dw"] Jun 02 15:38:00.297489 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.297403 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.301171 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.301119 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 15:38:00.316926 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.316894 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4cc769c5-888dw"] Jun 02 15:38:00.345967 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.345945 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bpvc5"] Jun 02 15:38:00.347942 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:38:00.347915 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8878eee5_4bcd_4370_9633_838b0333866c.slice/crio-dadb34e303aa3cee64cddabd359a9b7e23e52489068071915bbd57d23b77dc73 WatchSource:0}: Error finding container dadb34e303aa3cee64cddabd359a9b7e23e52489068071915bbd57d23b77dc73: Status 404 returned error can't find the container with id dadb34e303aa3cee64cddabd359a9b7e23e52489068071915bbd57d23b77dc73 Jun 02 15:38:00.349207 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.349185 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:38:00.377998 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.377976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/260058f7-72f2-414c-ac52-37d9d8ca6eb1-tls-cert\") pod \"authorino-5d4cc769c5-888dw\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.378110 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.378032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb42z\" (UniqueName: \"kubernetes.io/projected/260058f7-72f2-414c-ac52-37d9d8ca6eb1-kube-api-access-zb42z\") pod \"authorino-5d4cc769c5-888dw\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.479551 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.479460 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/260058f7-72f2-414c-ac52-37d9d8ca6eb1-tls-cert\") pod \"authorino-5d4cc769c5-888dw\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.479724 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.479547 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb42z\" (UniqueName: \"kubernetes.io/projected/260058f7-72f2-414c-ac52-37d9d8ca6eb1-kube-api-access-zb42z\") pod \"authorino-5d4cc769c5-888dw\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.481874 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.481851 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/260058f7-72f2-414c-ac52-37d9d8ca6eb1-tls-cert\") pod \"authorino-5d4cc769c5-888dw\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.489251 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.489231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb42z\" (UniqueName: \"kubernetes.io/projected/260058f7-72f2-414c-ac52-37d9d8ca6eb1-kube-api-access-zb42z\") pod \"authorino-5d4cc769c5-888dw\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.607230 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.607189 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:38:00.732472 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.732391 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4cc769c5-888dw"] Jun 02 15:38:00.735890 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:38:00.735857 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod260058f7_72f2_414c_ac52_37d9d8ca6eb1.slice/crio-ac8b832282da3b6ef0642b1fdc9b838e26cc0b3c9b4bfc1c74fc7175a7bf8f25 WatchSource:0}: Error finding container ac8b832282da3b6ef0642b1fdc9b838e26cc0b3c9b4bfc1c74fc7175a7bf8f25: Status 404 returned error can't find the container with id ac8b832282da3b6ef0642b1fdc9b838e26cc0b3c9b4bfc1c74fc7175a7bf8f25 Jun 02 15:38:00.975419 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.975383 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4cc769c5-888dw" event={"ID":"260058f7-72f2-414c-ac52-37d9d8ca6eb1","Type":"ContainerStarted","Data":"ac8b832282da3b6ef0642b1fdc9b838e26cc0b3c9b4bfc1c74fc7175a7bf8f25"} Jun 02 15:38:00.976656 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.976632 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" event={"ID":"8878eee5-4bcd-4370-9633-838b0333866c","Type":"ContainerStarted","Data":"1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b"} Jun 02 15:38:00.976773 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.976661 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" event={"ID":"8878eee5-4bcd-4370-9633-838b0333866c","Type":"ContainerStarted","Data":"dadb34e303aa3cee64cddabd359a9b7e23e52489068071915bbd57d23b77dc73"} Jun 02 15:38:00.976773 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.976727 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" podUID="8878eee5-4bcd-4370-9633-838b0333866c" containerName="authorino" containerID="cri-o://1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b" gracePeriod=30 Jun 02 15:38:00.998204 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:00.998159 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" podStartSLOduration=1.552363564 podStartE2EDuration="1.998143338s" podCreationTimestamp="2026-06-02 15:37:59 +0000 UTC" firstStartedPulling="2026-06-02 15:38:00.349414423 +0000 UTC m=+865.407584743" lastFinishedPulling="2026-06-02 15:38:00.795194212 +0000 UTC m=+865.853364517" observedRunningTime="2026-06-02 15:38:00.996846165 +0000 UTC m=+866.055016492" watchObservedRunningTime="2026-06-02 15:38:00.998143338 +0000 UTC m=+866.056313663" Jun 02 15:38:01.225550 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.225521 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:38:01.286520 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.286429 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvq82\" (UniqueName: \"kubernetes.io/projected/8878eee5-4bcd-4370-9633-838b0333866c-kube-api-access-wvq82\") pod \"8878eee5-4bcd-4370-9633-838b0333866c\" (UID: \"8878eee5-4bcd-4370-9633-838b0333866c\") " Jun 02 15:38:01.288441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.288415 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8878eee5-4bcd-4370-9633-838b0333866c-kube-api-access-wvq82" (OuterVolumeSpecName: "kube-api-access-wvq82") pod "8878eee5-4bcd-4370-9633-838b0333866c" (UID: "8878eee5-4bcd-4370-9633-838b0333866c"). InnerVolumeSpecName "kube-api-access-wvq82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:38:01.387441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.387406 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvq82\" (UniqueName: \"kubernetes.io/projected/8878eee5-4bcd-4370-9633-838b0333866c-kube-api-access-wvq82\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:38:01.981256 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.981212 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4cc769c5-888dw" event={"ID":"260058f7-72f2-414c-ac52-37d9d8ca6eb1","Type":"ContainerStarted","Data":"fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3"} Jun 02 15:38:01.982197 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.982173 2555 generic.go:358] "Generic (PLEG): container finished" podID="8878eee5-4bcd-4370-9633-838b0333866c" containerID="1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b" exitCode=0 Jun 02 15:38:01.982294 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.982212 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" Jun 02 15:38:01.982294 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.982225 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" event={"ID":"8878eee5-4bcd-4370-9633-838b0333866c","Type":"ContainerDied","Data":"1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b"} Jun 02 15:38:01.982294 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.982249 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bpvc5" event={"ID":"8878eee5-4bcd-4370-9633-838b0333866c","Type":"ContainerDied","Data":"dadb34e303aa3cee64cddabd359a9b7e23e52489068071915bbd57d23b77dc73"} Jun 02 15:38:01.982294 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.982263 2555 scope.go:117] "RemoveContainer" containerID="1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b" Jun 02 15:38:01.989598 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.989578 2555 scope.go:117] "RemoveContainer" containerID="1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b" Jun 02 15:38:01.989884 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:38:01.989861 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b\": container with ID starting with 1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b not found: ID does not exist" containerID="1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b" Jun 02 15:38:01.989964 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:01.989894 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b"} err="failed to get container status \"1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b\": rpc error: code = NotFound desc = could not find container \"1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b\": container with ID starting with 1c798f0b9a17e2229e9c300078e89f36be27f068e48b3119e9f815499d89163b not found: ID does not exist" Jun 02 15:38:02.000055 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.000009 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4cc769c5-888dw" podStartSLOduration=1.703947536 podStartE2EDuration="1.999994762s" podCreationTimestamp="2026-06-02 15:38:00 +0000 UTC" firstStartedPulling="2026-06-02 15:38:00.737167206 +0000 UTC m=+865.795337510" lastFinishedPulling="2026-06-02 15:38:01.033214431 +0000 UTC m=+866.091384736" observedRunningTime="2026-06-02 15:38:01.999295067 +0000 UTC m=+867.057465394" watchObservedRunningTime="2026-06-02 15:38:01.999994762 +0000 UTC m=+867.058165088" Jun 02 15:38:02.018944 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.018915 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bpvc5"] Jun 02 15:38:02.023896 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.023864 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bpvc5"] Jun 02 15:38:02.029334 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.029304 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-p46pn"] Jun 02 15:38:02.029592 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.029563 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-p46pn" podUID="2e8e5c22-190d-44bb-b906-42dc3ed46e46" containerName="authorino" containerID="cri-o://bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686" gracePeriod=30 Jun 02 15:38:02.274083 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.274061 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:38:02.395542 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.395510 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvzjr\" (UniqueName: \"kubernetes.io/projected/2e8e5c22-190d-44bb-b906-42dc3ed46e46-kube-api-access-jvzjr\") pod \"2e8e5c22-190d-44bb-b906-42dc3ed46e46\" (UID: \"2e8e5c22-190d-44bb-b906-42dc3ed46e46\") " Jun 02 15:38:02.397454 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.397421 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8e5c22-190d-44bb-b906-42dc3ed46e46-kube-api-access-jvzjr" (OuterVolumeSpecName: "kube-api-access-jvzjr") pod "2e8e5c22-190d-44bb-b906-42dc3ed46e46" (UID: "2e8e5c22-190d-44bb-b906-42dc3ed46e46"). InnerVolumeSpecName "kube-api-access-jvzjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:38:02.496113 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.496076 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvzjr\" (UniqueName: \"kubernetes.io/projected/2e8e5c22-190d-44bb-b906-42dc3ed46e46-kube-api-access-jvzjr\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:38:02.987688 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.987652 2555 generic.go:358] "Generic (PLEG): container finished" podID="2e8e5c22-190d-44bb-b906-42dc3ed46e46" containerID="bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686" exitCode=0 Jun 02 15:38:02.988082 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.987700 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p46pn" Jun 02 15:38:02.988082 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.987739 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p46pn" event={"ID":"2e8e5c22-190d-44bb-b906-42dc3ed46e46","Type":"ContainerDied","Data":"bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686"} Jun 02 15:38:02.988082 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.987769 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p46pn" event={"ID":"2e8e5c22-190d-44bb-b906-42dc3ed46e46","Type":"ContainerDied","Data":"beef758719b7da93e5db540b41be3929a242464981fff146130afa51f90d734a"} Jun 02 15:38:02.988082 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.987785 2555 scope.go:117] "RemoveContainer" containerID="bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686" Jun 02 15:38:02.995862 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.995846 2555 scope.go:117] "RemoveContainer" containerID="bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686" Jun 02 15:38:02.996117 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:38:02.996096 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686\": container with ID starting with bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686 not found: ID does not exist" containerID="bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686" Jun 02 15:38:02.996189 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:02.996127 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686"} err="failed to get container status \"bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686\": rpc error: code = NotFound desc = could not find container \"bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686\": container with ID starting with bba17ca4b997e0e7fb7265f0231f5e83bffc21a52968c0aadabe2bdbf3d5b686 not found: ID does not exist" Jun 02 15:38:03.019572 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:03.019541 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-p46pn"] Jun 02 15:38:03.025478 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:03.025458 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-p46pn"] Jun 02 15:38:03.488044 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:03.488012 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e8e5c22-190d-44bb-b906-42dc3ed46e46" path="/var/lib/kubelet/pods/2e8e5c22-190d-44bb-b906-42dc3ed46e46/volumes" Jun 02 15:38:03.488334 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:03.488322 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8878eee5-4bcd-4370-9633-838b0333866c" path="/var/lib/kubelet/pods/8878eee5-4bcd-4370-9633-838b0333866c/volumes" Jun 02 15:38:39.339433 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:38:39.339393 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:39:27.488665 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.488635 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b99d4c849-jlzlk"] Jun 02 15:39:27.490990 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.488889 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8878eee5-4bcd-4370-9633-838b0333866c" containerName="authorino" Jun 02 15:39:27.490990 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.488901 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8878eee5-4bcd-4370-9633-838b0333866c" containerName="authorino" Jun 02 15:39:27.490990 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.488918 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8e5c22-190d-44bb-b906-42dc3ed46e46" containerName="authorino" Jun 02 15:39:27.490990 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.488923 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8e5c22-190d-44bb-b906-42dc3ed46e46" containerName="authorino" Jun 02 15:39:27.490990 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.488995 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e8e5c22-190d-44bb-b906-42dc3ed46e46" containerName="authorino" Jun 02 15:39:27.490990 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.489002 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8878eee5-4bcd-4370-9633-838b0333866c" containerName="authorino" Jun 02 15:39:27.491845 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.491828 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.495290 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.495261 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 15:39:27.502249 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.502221 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b99d4c849-jlzlk"] Jun 02 15:39:27.579327 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.579292 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5p7b\" (UniqueName: \"kubernetes.io/projected/d1effe4a-c77d-4f77-adb1-d7ad2e419818-kube-api-access-b5p7b\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.579512 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.579427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1effe4a-c77d-4f77-adb1-d7ad2e419818-oidc-ca\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.579512 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.579461 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1effe4a-c77d-4f77-adb1-d7ad2e419818-tls-cert\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.680657 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.680621 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1effe4a-c77d-4f77-adb1-d7ad2e419818-oidc-ca\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.680824 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.680666 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1effe4a-c77d-4f77-adb1-d7ad2e419818-tls-cert\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.680824 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.680694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5p7b\" (UniqueName: \"kubernetes.io/projected/d1effe4a-c77d-4f77-adb1-d7ad2e419818-kube-api-access-b5p7b\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.681266 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.681232 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1effe4a-c77d-4f77-adb1-d7ad2e419818-oidc-ca\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.683019 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.683001 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1effe4a-c77d-4f77-adb1-d7ad2e419818-tls-cert\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.689443 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.689418 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5p7b\" (UniqueName: \"kubernetes.io/projected/d1effe4a-c77d-4f77-adb1-d7ad2e419818-kube-api-access-b5p7b\") pod \"authorino-6b99d4c849-jlzlk\" (UID: \"d1effe4a-c77d-4f77-adb1-d7ad2e419818\") " pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.801272 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.801184 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b99d4c849-jlzlk" Jun 02 15:39:27.940666 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:27.940636 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b99d4c849-jlzlk"] Jun 02 15:39:27.943105 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:39:27.943078 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1effe4a_c77d_4f77_adb1_d7ad2e419818.slice/crio-17ba8ec6732b87440126dcb0860372efcc53889c742f56043cfdf91666d39960 WatchSource:0}: Error finding container 17ba8ec6732b87440126dcb0860372efcc53889c742f56043cfdf91666d39960: Status 404 returned error can't find the container with id 17ba8ec6732b87440126dcb0860372efcc53889c742f56043cfdf91666d39960 Jun 02 15:39:28.249189 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:28.249154 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b99d4c849-jlzlk" event={"ID":"d1effe4a-c77d-4f77-adb1-d7ad2e419818","Type":"ContainerStarted","Data":"17ba8ec6732b87440126dcb0860372efcc53889c742f56043cfdf91666d39960"} Jun 02 15:39:29.253802 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.253767 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b99d4c849-jlzlk" event={"ID":"d1effe4a-c77d-4f77-adb1-d7ad2e419818","Type":"ContainerStarted","Data":"10e0c364edf839501354de46e329fd65eb8fbb3b342a4e374d25cd6cc5d70d52"} Jun 02 15:39:29.274531 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.274476 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6b99d4c849-jlzlk" podStartSLOduration=1.777775286 podStartE2EDuration="2.274456902s" podCreationTimestamp="2026-06-02 15:39:27 +0000 UTC" firstStartedPulling="2026-06-02 15:39:27.944487039 +0000 UTC m=+953.002657342" lastFinishedPulling="2026-06-02 15:39:28.441168648 +0000 UTC m=+953.499338958" observedRunningTime="2026-06-02 15:39:29.273471552 +0000 UTC m=+954.331641878" watchObservedRunningTime="2026-06-02 15:39:29.274456902 +0000 UTC m=+954.332627229" Jun 02 15:39:29.319036 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.319001 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4cc769c5-888dw"] Jun 02 15:39:29.319285 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.319261 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4cc769c5-888dw" podUID="260058f7-72f2-414c-ac52-37d9d8ca6eb1" containerName="authorino" containerID="cri-o://fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3" gracePeriod=30 Jun 02 15:39:29.566954 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.566930 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:39:29.699921 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.699890 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/260058f7-72f2-414c-ac52-37d9d8ca6eb1-tls-cert\") pod \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " Jun 02 15:39:29.699921 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.699925 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb42z\" (UniqueName: \"kubernetes.io/projected/260058f7-72f2-414c-ac52-37d9d8ca6eb1-kube-api-access-zb42z\") pod \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\" (UID: \"260058f7-72f2-414c-ac52-37d9d8ca6eb1\") " Jun 02 15:39:29.702003 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.701971 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260058f7-72f2-414c-ac52-37d9d8ca6eb1-kube-api-access-zb42z" (OuterVolumeSpecName: "kube-api-access-zb42z") pod "260058f7-72f2-414c-ac52-37d9d8ca6eb1" (UID: "260058f7-72f2-414c-ac52-37d9d8ca6eb1"). InnerVolumeSpecName "kube-api-access-zb42z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:39:29.709313 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.709284 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260058f7-72f2-414c-ac52-37d9d8ca6eb1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "260058f7-72f2-414c-ac52-37d9d8ca6eb1" (UID: "260058f7-72f2-414c-ac52-37d9d8ca6eb1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:39:29.800747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.800659 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/260058f7-72f2-414c-ac52-37d9d8ca6eb1-tls-cert\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:39:29.800747 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:29.800692 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb42z\" (UniqueName: \"kubernetes.io/projected/260058f7-72f2-414c-ac52-37d9d8ca6eb1-kube-api-access-zb42z\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jun 02 15:39:30.257887 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.257854 2555 generic.go:358] "Generic (PLEG): container finished" podID="260058f7-72f2-414c-ac52-37d9d8ca6eb1" containerID="fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3" exitCode=0 Jun 02 15:39:30.258301 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.257902 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4cc769c5-888dw" Jun 02 15:39:30.258301 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.257935 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4cc769c5-888dw" event={"ID":"260058f7-72f2-414c-ac52-37d9d8ca6eb1","Type":"ContainerDied","Data":"fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3"} Jun 02 15:39:30.258301 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.257970 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4cc769c5-888dw" event={"ID":"260058f7-72f2-414c-ac52-37d9d8ca6eb1","Type":"ContainerDied","Data":"ac8b832282da3b6ef0642b1fdc9b838e26cc0b3c9b4bfc1c74fc7175a7bf8f25"} Jun 02 15:39:30.258301 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.257985 2555 scope.go:117] "RemoveContainer" containerID="fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3" Jun 02 15:39:30.266589 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.266566 2555 scope.go:117] "RemoveContainer" containerID="fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3" Jun 02 15:39:30.266887 ip-10-0-140-163 kubenswrapper[2555]: E0602 15:39:30.266868 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3\": container with ID starting with fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3 not found: ID does not exist" containerID="fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3" Jun 02 15:39:30.266948 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.266894 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3"} err="failed to get container status \"fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3\": rpc error: code = NotFound desc = could not find container \"fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3\": container with ID starting with fa859723c37b6d90a92cb799de3c24d48f6561dfe8d47fbf378b28d79a6ae1d3 not found: ID does not exist" Jun 02 15:39:30.287422 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.287393 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4cc769c5-888dw"] Jun 02 15:39:30.289883 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:30.289854 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4cc769c5-888dw"] Jun 02 15:39:31.488385 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:31.488331 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="260058f7-72f2-414c-ac52-37d9d8ca6eb1" path="/var/lib/kubelet/pods/260058f7-72f2-414c-ac52-37d9d8ca6eb1/volumes" Jun 02 15:39:39.462846 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:39.462800 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:39:49.201044 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.201004 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk"] Jun 02 15:39:49.201591 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.201294 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260058f7-72f2-414c-ac52-37d9d8ca6eb1" containerName="authorino" Jun 02 15:39:49.201591 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.201304 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="260058f7-72f2-414c-ac52-37d9d8ca6eb1" containerName="authorino" Jun 02 15:39:49.201591 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.201369 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="260058f7-72f2-414c-ac52-37d9d8ca6eb1" containerName="authorino" Jun 02 15:39:49.205656 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.205634 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.209714 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.209687 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-px7g7\"" Jun 02 15:39:49.209850 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.209692 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 15:39:49.209850 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.209733 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 15:39:49.209850 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.209832 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 15:39:49.216264 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.216241 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk"] Jun 02 15:39:49.234041 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.234009 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.234228 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.234061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.234228 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.234091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.234228 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.234116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.234429 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.234308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.234429 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.234383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpvt7\" (UniqueName: \"kubernetes.io/projected/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-kube-api-access-tpvt7\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.334933 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.334897 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.334951 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.334986 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.335006 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.335049 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.335079 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpvt7\" (UniqueName: \"kubernetes.io/projected/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-kube-api-access-tpvt7\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335441 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.335396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335535 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.335447 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.335535 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.335472 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.337317 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.337293 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.337631 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.337613 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.345733 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.345709 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpvt7\" (UniqueName: \"kubernetes.io/projected/d238fcc9-6250-4f9e-bbf9-ec73ae2c2353-kube-api-access-tpvt7\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk\" (UID: \"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.516506 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.516410 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:49.648060 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.648034 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk"] Jun 02 15:39:49.650557 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:39:49.650527 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd238fcc9_6250_4f9e_bbf9_ec73ae2c2353.slice/crio-82f755076779dc71c6212e0ae5accd501756078d8de47eed2231716b07f6634c WatchSource:0}: Error finding container 82f755076779dc71c6212e0ae5accd501756078d8de47eed2231716b07f6634c: Status 404 returned error can't find the container with id 82f755076779dc71c6212e0ae5accd501756078d8de47eed2231716b07f6634c Jun 02 15:39:49.865568 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:49.865533 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:39:50.324954 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:50.324859 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" event={"ID":"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353","Type":"ContainerStarted","Data":"82f755076779dc71c6212e0ae5accd501756078d8de47eed2231716b07f6634c"} Jun 02 15:39:53.339801 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:53.339765 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" event={"ID":"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353","Type":"ContainerStarted","Data":"65196d85c6f09957c1ca2724c52ada9188d55903823368fd07e4391528c03859"} Jun 02 15:39:55.347738 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:55.347702 2555 generic.go:358] "Generic (PLEG): container finished" podID="d238fcc9-6250-4f9e-bbf9-ec73ae2c2353" containerID="65196d85c6f09957c1ca2724c52ada9188d55903823368fd07e4391528c03859" exitCode=0 Jun 02 15:39:55.348128 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:55.347775 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" event={"ID":"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353","Type":"ContainerDied","Data":"65196d85c6f09957c1ca2724c52ada9188d55903823368fd07e4391528c03859"} Jun 02 15:39:57.710631 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:57.710588 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:39:58.358541 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:58.358503 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" event={"ID":"d238fcc9-6250-4f9e-bbf9-ec73ae2c2353","Type":"ContainerStarted","Data":"de8dd537b5a34674878c6c6adbdb1c88be5fa7c1cd314b881e130202d599e3ec"} Jun 02 15:39:58.380325 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:58.380273 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" podStartSLOduration=0.800355899 podStartE2EDuration="9.380260283s" podCreationTimestamp="2026-06-02 15:39:49 +0000 UTC" firstStartedPulling="2026-06-02 15:39:49.652365727 +0000 UTC m=+974.710536045" lastFinishedPulling="2026-06-02 15:39:58.232270122 +0000 UTC m=+983.290440429" observedRunningTime="2026-06-02 15:39:58.378696592 +0000 UTC m=+983.436866920" watchObservedRunningTime="2026-06-02 15:39:58.380260283 +0000 UTC m=+983.438430608" Jun 02 15:39:59.516894 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:59.516850 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:59.516894 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:59.516897 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:39:59.529358 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:39:59.529321 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:40:00.375923 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:00.375895 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk" Jun 02 15:40:31.018365 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.018308 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h"] Jun 02 15:40:31.026334 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.026308 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.029216 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.029183 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 15:40:31.029743 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.029720 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h"] Jun 02 15:40:31.176505 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.176462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9e5ac6-5506-45eb-8436-63f849775be6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.176505 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.176504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.176775 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.176530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.176775 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.176598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqdg2\" (UniqueName: \"kubernetes.io/projected/5f9e5ac6-5506-45eb-8436-63f849775be6-kube-api-access-wqdg2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.176775 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.176665 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.176775 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.176731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.277963 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.277868 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.277963 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.277934 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9e5ac6-5506-45eb-8436-63f849775be6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.277963 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.277962 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.278239 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.277988 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.278239 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.278008 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqdg2\" (UniqueName: \"kubernetes.io/projected/5f9e5ac6-5506-45eb-8436-63f849775be6-kube-api-access-wqdg2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.278239 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.278043 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.278418 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.278330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.278418 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.278402 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.278497 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.278427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.280276 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.280253 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f9e5ac6-5506-45eb-8436-63f849775be6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.280634 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.280615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9e5ac6-5506-45eb-8436-63f849775be6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.291630 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.291603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqdg2\" (UniqueName: \"kubernetes.io/projected/5f9e5ac6-5506-45eb-8436-63f849775be6-kube-api-access-wqdg2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h\" (UID: \"5f9e5ac6-5506-45eb-8436-63f849775be6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.337882 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.337847 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:31.469177 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.469150 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h"] Jun 02 15:40:31.470754 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:40:31.470727 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9e5ac6_5506_45eb_8436_63f849775be6.slice/crio-55367cd145b47a5cff8f2d77b447740af6f24dd6e50e36bc712618a8ba90356f WatchSource:0}: Error finding container 55367cd145b47a5cff8f2d77b447740af6f24dd6e50e36bc712618a8ba90356f: Status 404 returned error can't find the container with id 55367cd145b47a5cff8f2d77b447740af6f24dd6e50e36bc712618a8ba90356f Jun 02 15:40:31.904623 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:31.904577 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:40:32.468972 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:32.468939 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" event={"ID":"5f9e5ac6-5506-45eb-8436-63f849775be6","Type":"ContainerStarted","Data":"f342f4bfa8b20b12fecb3a207760148f6c132db70bb8e36aba20b9c2d8b3416e"} Jun 02 15:40:32.468972 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:32.468975 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" event={"ID":"5f9e5ac6-5506-45eb-8436-63f849775be6","Type":"ContainerStarted","Data":"55367cd145b47a5cff8f2d77b447740af6f24dd6e50e36bc712618a8ba90356f"} Jun 02 15:40:33.473431 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:33.473399 2555 generic.go:358] "Generic (PLEG): container finished" podID="5f9e5ac6-5506-45eb-8436-63f849775be6" containerID="f342f4bfa8b20b12fecb3a207760148f6c132db70bb8e36aba20b9c2d8b3416e" exitCode=0 Jun 02 15:40:33.473803 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:33.473452 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" event={"ID":"5f9e5ac6-5506-45eb-8436-63f849775be6","Type":"ContainerDied","Data":"f342f4bfa8b20b12fecb3a207760148f6c132db70bb8e36aba20b9c2d8b3416e"} Jun 02 15:40:34.477769 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:34.477682 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" event={"ID":"5f9e5ac6-5506-45eb-8436-63f849775be6","Type":"ContainerStarted","Data":"c406d282a3b8c2eb53a7bcbd5232c521d0a19f92de9d898d6733cb7122ed25da"} Jun 02 15:40:34.499678 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:34.499621 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" podStartSLOduration=3.816664497 podStartE2EDuration="4.499606114s" podCreationTimestamp="2026-06-02 15:40:30 +0000 UTC" firstStartedPulling="2026-06-02 15:40:33.473961022 +0000 UTC m=+1018.532131330" lastFinishedPulling="2026-06-02 15:40:34.156902629 +0000 UTC m=+1019.215072947" observedRunningTime="2026-06-02 15:40:34.499080631 +0000 UTC m=+1019.557250957" watchObservedRunningTime="2026-06-02 15:40:34.499606114 +0000 UTC m=+1019.557776430" Jun 02 15:40:40.421054 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.421018 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds"] Jun 02 15:40:40.427044 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.427023 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.431568 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.431547 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 15:40:40.440914 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.440890 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds"] Jun 02 15:40:40.556578 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.556504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.556784 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.556702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.556784 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.556762 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.556985 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.556947 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.557068 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.557043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.557122 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.557114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87j9p\" (UniqueName: \"kubernetes.io/projected/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-kube-api-access-87j9p\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658026 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.657984 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658039 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658085 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658115 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658167 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87j9p\" (UniqueName: \"kubernetes.io/projected/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-kube-api-access-87j9p\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658226 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658199 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658527 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658599 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.658666 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.658585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.660325 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.660302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.660748 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.660725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.672212 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.672154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87j9p\" (UniqueName: \"kubernetes.io/projected/cbebdc60-658b-4c46-9e33-5f90c8b24d1f-kube-api-access-87j9p\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds\" (UID: \"cbebdc60-658b-4c46-9e33-5f90c8b24d1f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.737016 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.736971 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:40.896816 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:40.896788 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds"] Jun 02 15:40:40.898551 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:40:40.898526 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbebdc60_658b_4c46_9e33_5f90c8b24d1f.slice/crio-9dcb470d68caf5e5ff6628857cf325b745b1eaf3709e9bb49181a7b1de05dcf1 WatchSource:0}: Error finding container 9dcb470d68caf5e5ff6628857cf325b745b1eaf3709e9bb49181a7b1de05dcf1: Status 404 returned error can't find the container with id 9dcb470d68caf5e5ff6628857cf325b745b1eaf3709e9bb49181a7b1de05dcf1 Jun 02 15:40:41.338541 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.338506 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:41.338702 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.338562 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:41.351340 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.351315 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:41.500649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.500610 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" event={"ID":"cbebdc60-658b-4c46-9e33-5f90c8b24d1f","Type":"ContainerStarted","Data":"2688acba4a5be29dead5286d5de9960a2f4a7edc975a1855cd21803b0ebb66c6"} Jun 02 15:40:41.500649 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.500652 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" event={"ID":"cbebdc60-658b-4c46-9e33-5f90c8b24d1f","Type":"ContainerStarted","Data":"9dcb470d68caf5e5ff6628857cf325b745b1eaf3709e9bb49181a7b1de05dcf1"} Jun 02 15:40:41.512359 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.512310 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h" Jun 02 15:40:41.627340 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:41.627263 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:40:42.504538 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:42.504502 2555 generic.go:358] "Generic (PLEG): container finished" podID="cbebdc60-658b-4c46-9e33-5f90c8b24d1f" containerID="2688acba4a5be29dead5286d5de9960a2f4a7edc975a1855cd21803b0ebb66c6" exitCode=0 Jun 02 15:40:42.504905 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:42.504551 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" event={"ID":"cbebdc60-658b-4c46-9e33-5f90c8b24d1f","Type":"ContainerDied","Data":"2688acba4a5be29dead5286d5de9960a2f4a7edc975a1855cd21803b0ebb66c6"} Jun 02 15:40:43.514966 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:43.514877 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" event={"ID":"cbebdc60-658b-4c46-9e33-5f90c8b24d1f","Type":"ContainerStarted","Data":"dc23df3c07c1bb5af276d662415cdde20844ac0cc961ddf1c1cb50da9c4795eb"} Jun 02 15:40:43.538796 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:43.538745 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" podStartSLOduration=2.884145082 podStartE2EDuration="3.538729684s" podCreationTimestamp="2026-06-02 15:40:40 +0000 UTC" firstStartedPulling="2026-06-02 15:40:42.505091005 +0000 UTC m=+1027.563261309" lastFinishedPulling="2026-06-02 15:40:43.1596756 +0000 UTC m=+1028.217845911" observedRunningTime="2026-06-02 15:40:43.537137239 +0000 UTC m=+1028.595307564" watchObservedRunningTime="2026-06-02 15:40:43.538729684 +0000 UTC m=+1028.596900010" Jun 02 15:40:48.708400 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:48.704260 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-drzmd"] Jun 02 15:40:50.737845 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:50.737802 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:50.737845 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:50.737853 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:50.750332 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:50.750302 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:40:51.552306 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:40:51.552276 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds" Jun 02 15:46:32.349096 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:32.349064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b99d4c849-jlzlk_d1effe4a-c77d-4f77-adb1-d7ad2e419818/authorino/0.log" Jun 02 15:46:37.409200 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:37.409171 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-756bd9f55b-hmktr_fa10013d-fc2f-4374-ba29-652e451cd1ce/nginx/0.log" Jun 02 15:46:38.538172 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:38.538143 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf_cffc48eb-7911-4d83-a69e-77ae13daf414/copy-manifests/0.log" Jun 02 15:46:38.546498 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:38.546468 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf_cffc48eb-7911-4d83-a69e-77ae13daf414/manager/0.log" Jun 02 15:46:40.260449 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:40.259569 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b99d4c849-jlzlk_d1effe4a-c77d-4f77-adb1-d7ad2e419818/authorino/0.log" Jun 02 15:46:40.377754 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:40.377720 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-z754r_a14488a3-706a-47bd-9c20-4bc1c6b8f133/manager/0.log" Jun 02 15:46:40.742129 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:40.742098 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p6kzt_03cbc1bb-2225-4f0d-805a-9f7b238a5485/registry-server/0.log" Jun 02 15:46:40.994222 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:40.994139 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-drzmd_34e2fe50-7eb1-49a3-8b12-924d561ed42d/limitador/0.log" Jun 02 15:46:41.509292 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:41.509261 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4blknrh_11fdeebd-b060-4f4d-b305-ede3025e3d53/istio-proxy/0.log" Jun 02 15:46:41.998666 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:41.998639 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-4zrkm_6492fa59-e648-44a8-8666-53bd64d3e894/istio-proxy/0.log" Jun 02 15:46:42.727304 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:42.727277 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk_d238fcc9-6250-4f9e-bbf9-ec73ae2c2353/storage-initializer/0.log" Jun 02 15:46:42.735095 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:42.735072 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-vtqvk_d238fcc9-6250-4f9e-bbf9-ec73ae2c2353/main/0.log" Jun 02 15:46:42.995032 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:42.994959 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h_5f9e5ac6-5506-45eb-8436-63f849775be6/storage-initializer/0.log" Jun 02 15:46:43.001939 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:43.001919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9vvk7h_5f9e5ac6-5506-45eb-8436-63f849775be6/main/0.log" Jun 02 15:46:43.122536 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:43.122510 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds_cbebdc60-658b-4c46-9e33-5f90c8b24d1f/storage-initializer/0.log" Jun 02 15:46:43.129042 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:43.129019 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-lkmds_cbebdc60-658b-4c46-9e33-5f90c8b24d1f/main/0.log" Jun 02 15:46:47.218261 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.218223 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzc9k/must-gather-5742w"] Jun 02 15:46:47.221645 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.221627 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.224848 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.224819 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzc9k\"/\"default-dockercfg-7sr8k\"" Jun 02 15:46:47.225804 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.225786 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzc9k\"/\"kube-root-ca.crt\"" Jun 02 15:46:47.225910 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.225873 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzc9k\"/\"openshift-service-ca.crt\"" Jun 02 15:46:47.246470 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.246439 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/must-gather-5742w"] Jun 02 15:46:47.319521 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.319478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/24155214-75bb-40f8-839a-18d0387c98e8-must-gather-output\") pod \"must-gather-5742w\" (UID: \"24155214-75bb-40f8-839a-18d0387c98e8\") " pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.319700 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.319531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96w7g\" (UniqueName: \"kubernetes.io/projected/24155214-75bb-40f8-839a-18d0387c98e8-kube-api-access-96w7g\") pod \"must-gather-5742w\" (UID: \"24155214-75bb-40f8-839a-18d0387c98e8\") " pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.420855 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.420819 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/24155214-75bb-40f8-839a-18d0387c98e8-must-gather-output\") pod \"must-gather-5742w\" (UID: \"24155214-75bb-40f8-839a-18d0387c98e8\") " pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.420855 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.420861 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96w7g\" (UniqueName: \"kubernetes.io/projected/24155214-75bb-40f8-839a-18d0387c98e8-kube-api-access-96w7g\") pod \"must-gather-5742w\" (UID: \"24155214-75bb-40f8-839a-18d0387c98e8\") " pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.421173 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.421154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/24155214-75bb-40f8-839a-18d0387c98e8-must-gather-output\") pod \"must-gather-5742w\" (UID: \"24155214-75bb-40f8-839a-18d0387c98e8\") " pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.430190 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.430168 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96w7g\" (UniqueName: \"kubernetes.io/projected/24155214-75bb-40f8-839a-18d0387c98e8-kube-api-access-96w7g\") pod \"must-gather-5742w\" (UID: \"24155214-75bb-40f8-839a-18d0387c98e8\") " pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.531051 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.530963 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/must-gather-5742w" Jun 02 15:46:47.659399 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.659373 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/must-gather-5742w"] Jun 02 15:46:47.662199 ip-10-0-140-163 kubenswrapper[2555]: W0602 15:46:47.662171 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24155214_75bb_40f8_839a_18d0387c98e8.slice/crio-2b4d37ce6afe5c06d79dbad5f00dfca7fb41ffa18e4419398b387e4f79f05f86 WatchSource:0}: Error finding container 2b4d37ce6afe5c06d79dbad5f00dfca7fb41ffa18e4419398b387e4f79f05f86: Status 404 returned error can't find the container with id 2b4d37ce6afe5c06d79dbad5f00dfca7fb41ffa18e4419398b387e4f79f05f86 Jun 02 15:46:47.664338 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.664323 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:46:47.679945 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:47.679919 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/must-gather-5742w" event={"ID":"24155214-75bb-40f8-839a-18d0387c98e8","Type":"ContainerStarted","Data":"2b4d37ce6afe5c06d79dbad5f00dfca7fb41ffa18e4419398b387e4f79f05f86"} Jun 02 15:46:48.686147 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:48.686065 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/must-gather-5742w" event={"ID":"24155214-75bb-40f8-839a-18d0387c98e8","Type":"ContainerStarted","Data":"5604290bc952271a3a5ffe0dd555e0cb4de33486b16b2056c42c30fd81aaea6f"} Jun 02 15:46:48.686147 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:48.686103 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/must-gather-5742w" event={"ID":"24155214-75bb-40f8-839a-18d0387c98e8","Type":"ContainerStarted","Data":"c90726916a17be76b3b16d4b8db979fab38cbbc17935586b4dcb27e2b83cb406"} Jun 02 15:46:48.705911 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:48.705739 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nzc9k/must-gather-5742w" podStartSLOduration=1.010250337 podStartE2EDuration="1.705716164s" podCreationTimestamp="2026-06-02 15:46:47 +0000 UTC" firstStartedPulling="2026-06-02 15:46:47.664469288 +0000 UTC m=+1392.722639592" lastFinishedPulling="2026-06-02 15:46:48.35993511 +0000 UTC m=+1393.418105419" observedRunningTime="2026-06-02 15:46:48.703176008 +0000 UTC m=+1393.761346341" watchObservedRunningTime="2026-06-02 15:46:48.705716164 +0000 UTC m=+1393.763886516" Jun 02 15:46:50.099522 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:50.099485 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j82lr_c6374b65-94c2-4ecd-b144-17c622038c28/global-pull-secret-syncer/0.log" Jun 02 15:46:50.312027 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:50.311994 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wz9wd_2b5a810e-469d-4382-8776-f924b7d44227/konnectivity-agent/0.log" Jun 02 15:46:50.378689 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:50.378601 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-163.ec2.internal_d8fb5d6b57d05baaccb153cf6066385d/haproxy/0.log" Jun 02 15:46:54.632966 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:54.632931 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b99d4c849-jlzlk_d1effe4a-c77d-4f77-adb1-d7ad2e419818/authorino/0.log" Jun 02 15:46:54.661252 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:54.661219 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-z754r_a14488a3-706a-47bd-9c20-4bc1c6b8f133/manager/0.log" Jun 02 15:46:54.761006 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:54.760974 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p6kzt_03cbc1bb-2225-4f0d-805a-9f7b238a5485/registry-server/0.log" Jun 02 15:46:54.825451 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:54.825426 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-drzmd_34e2fe50-7eb1-49a3-8b12-924d561ed42d/limitador/0.log" Jun 02 15:46:56.904619 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:56.904588 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-shfzx_72592af6-da49-4316-ba1b-a19d2abf1070/node-exporter/0.log" Jun 02 15:46:56.932122 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:56.932061 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-shfzx_72592af6-da49-4316-ba1b-a19d2abf1070/kube-rbac-proxy/0.log" Jun 02 15:46:56.973392 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:56.973361 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-shfzx_72592af6-da49-4316-ba1b-a19d2abf1070/init-textfile/0.log" Jun 02 15:46:58.697916 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.697883 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv"] Jun 02 15:46:58.706330 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.706306 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.717902 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.717878 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv"] Jun 02 15:46:58.735135 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.735103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-proc\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.735468 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.735442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zwjz\" (UniqueName: \"kubernetes.io/projected/66d5e559-d73a-4bef-82cb-ae0668254131-kube-api-access-7zwjz\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.735683 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.735665 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-lib-modules\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.735843 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.735825 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-podres\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.735957 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.735942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-sys\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.836607 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836566 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zwjz\" (UniqueName: \"kubernetes.io/projected/66d5e559-d73a-4bef-82cb-ae0668254131-kube-api-access-7zwjz\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.836800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836645 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-lib-modules\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.836800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836693 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-podres\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.836800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-sys\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.836800 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836743 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-proc\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.837003 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836806 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-sys\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.837003 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836821 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-podres\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.837003 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836809 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-proc\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.837003 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.836829 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66d5e559-d73a-4bef-82cb-ae0668254131-lib-modules\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:58.845157 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:58.845120 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zwjz\" (UniqueName: \"kubernetes.io/projected/66d5e559-d73a-4bef-82cb-ae0668254131-kube-api-access-7zwjz\") pod \"perf-node-gather-daemonset-fk8xv\" (UID: \"66d5e559-d73a-4bef-82cb-ae0668254131\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:59.023034 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:59.022948 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:59.197396 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:59.197340 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv"] Jun 02 15:46:59.734868 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:59.734832 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" event={"ID":"66d5e559-d73a-4bef-82cb-ae0668254131","Type":"ContainerStarted","Data":"8da7fac146b9c826673ad3489c9c54ccdd445024c1914c642e9cc3156fc27fac"} Jun 02 15:46:59.734868 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:59.734871 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" event={"ID":"66d5e559-d73a-4bef-82cb-ae0668254131","Type":"ContainerStarted","Data":"d7327c71de640127fffc61043ea4855ef261af506af6d4492c75e11fe7c6d5dc"} Jun 02 15:46:59.735419 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:59.734950 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:46:59.754367 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:46:59.754294 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" podStartSLOduration=1.754275531 podStartE2EDuration="1.754275531s" podCreationTimestamp="2026-06-02 15:46:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:46:59.751859399 +0000 UTC m=+1404.810029727" watchObservedRunningTime="2026-06-02 15:46:59.754275531 +0000 UTC m=+1404.812445850" Jun 02 15:47:01.233744 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:01.233712 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4c65x_36e443ce-99da-4941-b80d-9da759ccd7c6/dns/0.log" Jun 02 15:47:01.301871 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:01.301841 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4c65x_36e443ce-99da-4941-b80d-9da759ccd7c6/kube-rbac-proxy/0.log" Jun 02 15:47:01.476470 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:01.476439 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-25mpd_223c4307-56a0-493b-a586-91711c510cae/dns-node-resolver/0.log" Jun 02 15:47:02.080114 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:02.080084 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gsk6p_dfc25338-688b-4fa6-8c24-336aae6fdc53/node-ca/0.log" Jun 02 15:47:03.040548 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:03.040506 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4blknrh_11fdeebd-b060-4f4d-b305-ede3025e3d53/istio-proxy/0.log" Jun 02 15:47:03.184042 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:03.184013 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-4zrkm_6492fa59-e648-44a8-8666-53bd64d3e894/istio-proxy/0.log" Jun 02 15:47:03.877300 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:03.877272 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6s6sk_8a40dda6-f5c5-4748-9156-584008e60fd9/serve-healthcheck-canary/0.log" Jun 02 15:47:04.404960 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:04.404933 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-895kp_f13e7b81-1823-46b7-a317-4725f9676f12/kube-rbac-proxy/0.log" Jun 02 15:47:04.425026 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:04.424994 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-895kp_f13e7b81-1823-46b7-a317-4725f9676f12/exporter/0.log" Jun 02 15:47:04.446781 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:04.446746 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-895kp_f13e7b81-1823-46b7-a317-4725f9676f12/extractor/0.log" Jun 02 15:47:05.749193 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:05.749167 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-fk8xv" Jun 02 15:47:06.681145 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:06.681106 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-756bd9f55b-hmktr_fa10013d-fc2f-4374-ba29-652e451cd1ce/nginx/0.log" Jun 02 15:47:07.019610 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:07.019527 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf_cffc48eb-7911-4d83-a69e-77ae13daf414/manager/0.log" Jun 02 15:47:07.039809 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:07.039785 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-dfmtf_cffc48eb-7911-4d83-a69e-77ae13daf414/copy-manifests/0.log" Jun 02 15:47:08.776023 ip-10-0-140-163 kubenswrapper[2555]: I0602 15:47:08.775998 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5546797fcb-bznd9_c93128e0-a75a-4c42-a2a2-a470d5b0ee20/manager/0.log"